I just did a cenus search and found him. He is listed in the 1880 census as a gunsmith in River Falls, Pierce County, Wisconsin. His name was Benjamin Lawrence. He was 53 years old, born in Vermont. His wife Susan was 49, born in New York. He had three children, Frank, age 14; Emma, age 11; and William, age 9. All three were born in Wisconsin, indicating that he was there at least as early as 1866, although I did not find him in the 1870 census.