Bruford was born on 17 May 1949 in Sevenoaks, Kent, the third child of Betty and John Bruford, a local veterinary surgeon.
During his time at boarding school, Bruford befriended several fellow jazz fans, one of them a drummer who gave Bruford lessons in improvisation and a tutorial book by American jazz drummer Jim Chapin.