According to Robinson, it was called Watelei in the Domesday Book of 1086, when the tenants of the Abbot of Glastonbury Abbey were Walter Hussey and John the Usher.
The village gives its name to Whatley Quarry, which lies to the north-west of the village at and is said to be one of the largest in Europe.