The history of the modern Altavilla began around the year 1080 when the Normans with Robert Guiscard erected the Norman Castle that dominates the town and the Church of St. Giles.
During the 15th century the Franciscans arrived in Altavilla and built a two-storey convent with a center cloister, and around it they built a Church dedicated to St. Francis of Assisi, a refectory, a library and a parlor.