Rivers was born in Decatur, Alabama, where his father, Steve, was the head coach of Decatur High's football team and his mother, Joan, was a teacher.
As Rivers's senior season unfolded, he established himself as the best prep passer in the state of Alabama.