Following his conversion to Christianity at age 17 Baller was one of the first students of the Missionary Institute established in the East End of London by Henry Grattan Guinness.
Baller studied the Chinese language in Nanking (Nanjing), then just recently liberated from the ravages of the Taiping rebels.