Kerr was born in Aberdeen, where he trained as an architect.
Together with the only 18 year old Charles Gray, in 1847 Kerr was a founder of the Architectural Association (AA), becoming its first President, 1847-48.