Porter was born in 1847 into an African-American family in Hartford, Connecticut.
In 1869, after two years of art study at Wesleyan Academy (now known as the Wilbraham & Monson Academy) in Wilbraham, Massachusetts, Porter went to New York City to study at the National Academy of Design.