Swartwout was born in Poughkeepsie, New York into a military and merchant family of Dutch ancestry.
War of 1812, Quartermaster General Swartwout dispatched the letter to Major General and later 9th President of the United States William Henry Harrison, June 2, 1813 announcing the American victory at the Second Battle of Sackett's Harbor on May 29, 1813.