During his studies at the seminary, Baker was part of a group of 108 that went on a pilgrimage to Rome in 1874 to support the creation of the Papal States.
A few days after Father Baker returned to Limestone Hill, a group of creditors informed the priest that the three parish institutions had amassed a sizeable debt, and they demanded immediate payment.