Richardson was born at Edlington, Yorkshire, to Rev. George Richardson and Isabel Nussey, the second of five daughters. She was first exposed to mountaineering when she visited the Alps at the age of sixteen. She began climbing at seventeen, starting with the mountains Piz Languard and Piz Corvatsch.