Don't sweat it at all, as the others are saying it is a good thing. I intentionally do this with pistols I make exactly as in the photo Jerry posted. The only time it would be a problem is if there is also run-out towards the triggerguard, which could make the wood awfully thin when you go to shape the lower forestock.
-Eric