In 1863 Paterson records that the tower was undergoing some repairs at the end of the 17th century when a part of the roof fell in, after which the castle was completely abandoned.
A 'Kragy' castle is marked on Timothy Pont's map of c.1600.