 In the mid-1960s, Ellison traveled to Rochester, New York, where he met the original members of the Soul Brothers Five, becoming the sixth member and prompting the band to change its name to the Soul Brothers Six.The other members of the group included Charles Armstrong, Harry Armstrong, Vonnell Benjamin, Lester Pelemon, and Joe Johnson.The group signed a recording contract with Atlantic Records.