Downing Street is a street in London , close to Whitehall and Buckingham Palace . Downing Street is located in Whitehall in central London , a few minutes ' walk from the Houses of Parliament and a little farther from Buckingham Palace .