Baxter was Liberal Member of Parliament for Montrose Burghs from 1855 to 1885, and served under William Ewart Gladstone as Secretary to the Admiralty from 1868 to 1871 and as Financial Secretary to the Treasury from 1871 to 1873.
He retired from Parliament in 1885.