Phillip has a daughter, Kimberly, and two adopted African American sons, Willis and his younger brother Arnold Jackson.
Phillip had dated several women, and would later get remarried to Maggie McKinney, a television aerobics instructor (played by Dixie Carter from 1983-1985 and Mary Ann Mobley from 1985-1986).