I have tried vises mounted at the end of free-standing benches in past shops. The bench often got in the way when I was working on that side of the vise. My current shop is very small with the typical wall mounted bench (6') and centered vise. works well but, as you said, I am constantly flipping the gun. Also, the vise tends to get in the way when I am just working at the bench. The vise and outrigger supports are easily removable, but that is a nuisance too.
In past threads, members have posted pix of free-standing vises. As I recall, some had outriggers to support the overhanging bits. IMHO, that is pretty much the perfect setup. If I ever have enough space, that is the setup I intend to have.
Laurie