Sullivan was a member of the New York State Assembly (New York Co., 2nd D.) in 1887, 1888, 1889, 1890, 1891, 1892 and 1893.
He was elected as a Democrat to the 58th and 59th United States Congresses, holding office from March 4, 1903, until his resignation on July 27, 1906.