 Baily was born in Glastonbury in Somerset on 17 July 1880, the son of Henry Shore Baily of The Elms in Glastonbury.He played club cricket as a batsman for Glastonbury Cricket Club, where he topped the club's batting averages in 1901.He made a single first-class appearance for Somerset, during the 1902 season, against Surrey.