Ross was born in Iowa City, Iowa to Carl Ross and Violet Phinisse Scott, and was raised in Flint, Michigan and Los Angeles, California.
In Seattle, Ross became involved with the local chapter of the Congress of Racial Equality, and was eventually elected president of the chapter.