The building material was sandstone (called “freestone” because it was so easy to quarry), which was porous and susceptible to cracking in freezing weather. Scottish stonemasons whitewashed the building in 1798 to protect the stone, leading to its being called the White House.