In the 1940s, Young was labelled a fellow traveler of the Communist Party by belonging to groups whose members also belonged to the Party, and was accused of being a former member.
Young built his political base on the East Side in the 1940s and 1950s.