I should have mentioned this. Mark Silver has a couple of DVDs available from American Pioneer Video on building longrifles only with hand tools.
You are going to have to buy most of these tools used on ebay or the like. They just don't make good hand tools these days unless they are very expensive. If you buy one of the name brands such as Stanley or Disston made before WWII, you should be getting something good. The older the tool, the better the quality, usually. Late 18th or 19th century is best. You can get very serviceable tools cheap if you don't mind chips and scratches in the paint or paint splatters. The collectors don't want these, but missing paint ( or some extra paint) has nothing to do with how it works. You will need to learn to recondition and sharpen planes, saws, and chisels. A draw knife is a must have for rapid stock removal on the butt. A really sharp one will lop hard maple off like it is styrofoam as long as you are cutting in the right direction. Don't waste you time with metal spoke shaves. Get the older wooden spoke shaves in a couple different sizes. They go around curves better. Basically, you need a few saws, a draw knife, a couple spoke shaves, and a good assortment of planes, chisels, files, and scrapers. If you have a place to do the heat treating of the blades, wood planes are easy to make as are chisels and scrapers. I stock various sizes of 1095 steel for making such tools. A period brace and bits are also good as are gimlets. You can get a nice set of French made gimlets from Garret Wade for about $20. They handle the small holes.
You could make a large wooden tool box to hold all the tools you would need. Look at some of the old 19th century carpenters tools boxes for examples.
The one thing that you MUST have that takes up some room is a good solid bench. You will need something about 20"x72"x36". I have a couple made of 2x4s and 3/4" plywood that would probably work for you. They are made up of two ladder frames with legs bolted on the front. The back of the ladder frames are screwed into wall studs with lag screws. That makes them as solid as the wall. Then order the multi-vise from Garret-Wade to go on the bench.
You can do this, but it is going to take some time to get everything together and ready for gun work. Collecting the tools and learning what to do with them is a lifelong hobby in itself. I have been buying and making tools since I was a kid. I am 52 now and almost have everything I need.
There are lots of little jigs and special tools that make things a lot easier.
You might want to find a friend with a well equipped shop to make you some of the things you can't buy.