Following high school, Willingham attended the College of the Desert in Palm Desert, California, where he was a two-year starter at cornerback.
After junior college, Willingham attended the University of Tennessee.