Patterson is originally from Sacramento, California, but while visiting some family in Los Alamitos, California in between 8th and 9th grades, he decided to stay down there so that he could play football at Los Alamitos High School.
Patterson became a very good player even though he had never played at all prior to the summer camp.