Jackson was born Kattie B. Scruse in Clayton, Alabama to Martha (née Upshaw; December 14, 1907 - April 25, 1990) and Prince Albert Scruse (October 16, 1907 - January 21, 1997).
At four, Jackson's family moved to East Chicago, Indiana, an industrial city in northwest Indiana near Chicago.