Kaltenbach started his playing career with Basel in 1911 and played for the team until 1927.
On 24 April 1921, Kaltenbach played in a comparison match between a Berlin city selection and FC Basel, in front of 35,000 spectators, he was honoured as best Basel players.