Fraser was born in Hove, England, on 23 August 1933.
Fraser met Anthony Newley while working at Decca Records in the 1950s and was hired as arranger and musical director of Newley and Leslie Bricusse's new stage musical, Stop the World - I Want to Get Off.