That is a good point. It depends on how you do different jobs.
I use my lathes and mill every week. A list of jobs that can be done better with a lathe might be helpful. IN my shop,
Lathe: Making and installing breech plugs, crowinng, cutting barrels, making and modifying screws, making piloted reamers and countersinks, ramrod tips, ramrod jags, bullet moulds, wood turing, ...
Mill, think of it as a faster more accurate file, so making sights, hogging off material, dovetails, inlettting stocks, truing stocks blanks as with a wood planer, ...
I guess once you get used to having such tools you find lots of ways to use them. Sure they did not have these tools 200 years ago and they made guns. It is much easier and faster to do a better job if you have them today.