The name first appears as Grazeley around 1598 and is derived from the Anglo-Saxon Griesley meaning grazing land (meadow).
During the 12th century, the Abbot of Reading was Lord of the Manor of Hartley Dummer, which appears to have been around Grazeley.