In New Hampshire, Bemis bought land from innkeeper Abel Crawford, who had pioneered tourism in the White Mountains. This property included most of today's Crawford Notch. Spurned in romance shortly after his move, Bemis built a granite mansion and became an eccentric recluse. At one time called the Lord of the Valley, Bemis named a lake, mountain, brook, ridge, and other spots in the White Mountains for himself. In an obituary published in 1881, he was described as not as odd as might be expected, yet sufficiently so to distinguish him from the ordinary run of men. His house, now known as the Notchland Inn, currently operates as a bed-and-breakfast establishment. Bemis is buried beside the house.