Born in Barrie, Ontario, Storey was working in a rail yard when he received an offer to play football with the Toronto Argonauts.
At the same time he was playing football, Storey was also playing competitive lacrosse.