The castle was sited on and near an earlier native fortification known as a cathair (stone fort), which gave its name to the place.
Granted to the powerful Butler family in late 14th century, the castle was enlarged and remodelled between the 15th and 17th centuries.