Blackstone was born in Branford, Connecticut, the sixth child, and fourth son, of James Blackstone and Sarah Beach.
Health issues caused Blackstone to drop out of school in 1847, and he began working for Roswell B. Mason, surveying the New York and New Haven Railroad (NY&NH).