Actually not so. The stock drops enough that the rifle best fits into the upper arm and is not at all uncomfortable. You must also remember that the average man today is almost a giant compared to the average man of 150 years in the past.
Though not a terribly heavy piece, the gun would not have had a violent recoil. Enough weight to temper the smaller caliber along with the unique characteristics of black power would make for a gentle shooter... Other than for the cloud of smoke.