Due to its geographical position it has seen the passage of many cultures, vestiges of which can be seen to this day in various archaeological sites.
Around the year 1500 a strong earthquake hit Albox destroying a large part of the town, making it necessary to demolish the ancient castle and the damaged homes were repaired with its stone.