The solent reminded by Prince Albert of the Bay of Naples , but the old house was too small for their needs , and the house was demolished and rebuilt by Thomas Cubitt . The setting of the existing three storey Georgian house appealed to Queen Victoria and Prince Albert ; in particular , the views of the Solent reminded Albert of the Bay of Naples in Italy . It soon became obvious that it was too small for their needs .