Put the lubed felt wad between powder and shot. Either ditch the fiber wad entirely or put it,,, heavily lubed (as in soaked overnight I'm olive oil) on top, separated from shot by one thin overshot card.
My usual small game load for a 20 gauge (reduce shot and powder for smaller gage as needed) is 60 to 65 grains 3f or 2f powder, thin overshot card, lubed felt wad or lubed ball of "faux-tow" (shredded sisal rope), 1 to 1 1/8oz. shot (I like #5 for almost everything in my area), topped with another thin overshot card.
Turkey load is different.