Harrelson was born in Woodruff, South Carolina, and his family moved to Savannah, Georgia, when he was in fifth grade.
He played golf, baseball, football and basketball at Benedictine Military School in Savannah, Georgia.