Born in Sainte-Flore, Mauricie, Quebec to a family of modest means, he began his studies at the College Séraphique and at Trois-Rivières Seminary, and finally, in Nicolet.
In 1938, Ayotte moved to Montreal and worked as a model at the École des beaux-arts de Montréal and the Montreal Museum of Fine Arts.