 In the general election he faced Democrat Charles Whiting, who attempted to portray Larrabee as an unredeemed capitalist and owners of many locals' debts.The election was relatively close, but Larrabee won with 175,504 votes to Whiting's 168,502.After serving two terms as governor, Larrabee retired to Montauk, his family mansion in Clermont.