There is a datestone of 1634 built into the side of the original Novar House, which is now part of the west side of the inner courtyard.
The building was altered and rebuilt as a classical square by Sir Hector Munro on his return from India in 1765.