 As a child he learned to play the piano.Rathburn attended Saint John High School, and received a Licentiate of Music from McGill University in 1937.The following year, he won the Canadian Performing Rights Society Scholarship Competition, and began performing on the piano for local dance bands and radio broadcasts, including with Don Messer.