A keep, known as the Tower of Kingorne Wester, was in existence on the site from 1119. It was later referred to as Burntisland Castle, and by 1382 was called Abbot's Hall, as it was the home of the Abbot of Dunfermline. The present building is largely of the 16th century, though with a 13th-century basement, which contains lancet windows and may represent the remains of a chapel. It was rebuilt by Peter Durie of Durie from 1552, and the arms of Abbot George Durie, and the date 1554, appear over the main door.