I think I found your original owner.

http://wigenweb.org/dane/biographies/barronqh.html
Q. H. BARRON was born in Rockingham, at Saxton's River Village, Windham Co., Vt., May 26, 1810; moved from there to Mount Morris, N.Y., in 1824, engaged in mercantile business most of the time at Nunda, for about ten years prior to his coming to Wisconsin, in September 1844, and in December of same year, he located at Fox Lake; was one of the first settlers in that section of the State, and has since resided there; engaged in farming on Secs. 33, 34, Township 12, Range 13, and remained at that business most of the time until 1868; was part of the time engaged in keeping hotel at Fox Lake; after 1868 his sole business was hotel-keeping, until 1878, when he was appointed Superintendent of public property; since living at Fox Lake, he has served as Justice of the Peace for twenty-seven years, Chairman, Board of Supervisors twice, Assessor twelve years, member of the Assembly in 1857 and in 1862; was Assistant Sergeant-at-Arms in 1858. Married at Nunda, September 1835, Sylvia H. ASHLEY; she was born in Whitesboro, Oneida Co., N.Y. Now resides at Fox Lake. Mr. BARRON is still a resident of Fox Lake.