Karolidis was born in 1849 in the village of Androniki (Turkish: Endürlük, now a suburb of Kayseri) in Cappadocia.
On his return from Germany, he initially taught in the Greek high schools of Pera and Chalcedon.