Cullahill Castle was the principal stronghold of the MacGillapatricks of Upper Ossory built around 1425 and destroyed around 1650. Cullahill Castle takes its name from an ancient forest that covered Cullahill Mountain and extended down to Cullahill village.