In 1965 he was appointed assistant archivist at Surrey Record Office at Kingston upon Thames before moving to Somerset Record Office in 1967 where he spent the rest of his working life.
Bush wrote his first book in 1977, and produced volumes on the history of Taunton, Exmouth and Wellington, followed by a series of books on the county of Somerset.