Quinn grew up first in El Paso, Texas, and later the Boyle Heights and the Echo Park areas of Los Angeles, California.
As a young man, Quinn boxed professionally to earn money, then studied art and architecture under Frank Lloyd Wright, at Wright's Arizona residence and his Wisconsin studio, Taliesin.