Sounds good so far - 25 yards, I find, is good for roughing in the sights but tells very little as to a load's actual accuracy.
Have you shot it at 50 yards yet?
It's really nice when things come together - several of us here have .40's too. We use .395" cast pure lead balls or larger as in .398" to .400", along with thicker patching as well.
Experimentation is more than 1/2 the fun.