Born in Cornwallis, Nova Scotia, the son of Dr. Jonathan Borden and Maria Frances Brown.
He entered politics in 1874 with election as a Liberal member from Kings County, Nova Scotia; aside from an interruption 1882-1887, he represented this constituency until 1911.