They lived with Daisy 's parents in Washington , D.C. James Edward Ellington ( J.E. ) was born in Lincolnton , North Carolina on April 15 , 1879 and moved to Washington , D.C. in 1886 with his parents . They lived with his maternal grandparents at 2129 Ida Place ( now Ward Place ) , NW in the West End neighborhood of Washington , D.C. His father , James Edward Ellington was born in Lincolnton , North Carolina on April 15 , 1879 and moved to Washington , D.C. in 1886 with his parents .