 Brown was drafted as an outfielder by the San Diego Padres in the 19th round of the 2016 Major League Baseball Draft.He signed with the Padres, which prevented him from playing baseball at Ole Miss, but he was still eligible to play football.At Ole Miss, he majored in General Studies with an emphasis in Education, Journalism and Legal Studies.