10 Downing Street is the address of the London residence and office of the Prime Minister of the United Kingdom . The most famous address in Downing Street is 10 Downing Street , the official residence of the First Lord of the Treasuryâ '' and thus , in modern times , the residence of the Prime Minister .