 At the end of his apprenticeship, in 1853, he began Albert Lea, Minnesota's first newspaper, the "Southern Star".From there he started the "Banner" in La Crescent before establishing the "Union Democrat" in La Crosse.In 1860, Swineford sold his interests in his newspapers and moved to Milwaukee, Wisconsin, where he published the "Daily Inquirer".