Despite its relative small size, Columbia was once the county seat of Henry County (before the county was divided to form Houston county.)
Brothers John Anglin and Clarence Anglin, made famous for escaping from Alcatraz Island, robbed the Columbia bank of $19,000 in January 1959 .