Soon after Fitzgerald was born , her parents separated and she went to live in Yonkers , New York with her mother and her mother 's boyfriend , Joseph Da Silva . The pair separated soon after her birth and she and her mother went to Yonkers , N. Y , where they eventually moved in with Tempie 's longtime boyfriend Joseph Da Silva .