 He was a Republican member of the New York State Assembly (Livingston Co.) in 1894, 1895, 1896, 1897, 1898, 1899, 1900, 1901 and 1902.In November 1902, he ran for County Judge of Livingston County, but was unexpectedly defeated.Subsequently his party friends forced Theodore P. Gilman to resign the office of First Deputy Comptroller, and had Kelsey appointed to the post.