 Johnson was born Ella Mae Smith on January 13, 1904, in Dallas, Texas.She never met her father, and she became an orphan when her mother died of tuberculosis when she was four years old.She was raised by her neighbors, the Davis family.