Its most important area , Westminster , contains the Houses of Parliament , Whitehall , Downing Street and Westminster Abbey . Westminster contains many of the most famous sites in London . Some of the popular tourist sites are Buckingham Palace , Palace of Westminster ( Houses of Parliament ) and Big Ben and nearby Westminster Abbey .