He became a member of the Society of Artists and sent work to their exhibitions. In 1924 he designed their medal, and in 1927 was responsible for sculpture for the National War Memorial at Adelaide. In the same year he was awarded the Wynne prize at Sydney. His best-known works are the figures on the exterior of the ANZAC War Memorial in Hyde Park, Sydney, the central group in the interior, and the bronze reliefs. The figures on the exterior and the interior group, including Sacrifice, are cited by sculptor, Ron Robertson-Swann as "Sydney's most moving example of publicly visible architecture". Art historian, Professor Virginia Spate, wrote in 1999: "Even incomplete, [it] is the most perfect sculptural monument in Australia." An example of his sculpture associated with architecture is at the University of Sydney, where four medallion portraits of great scientists are on the façade of the physics building. Rayner also produced a variety of smaller work, built up a fine school of sculpture, and in 1934 was commissioned to design the Victorian centenary medal. His use of a ram's head as the design for one side of it was much criticized, and it is not one of his most successful efforts. At the time of his death on 19 November 1937 he was engaged on the George V Memorial for Canberra. He had recently been commissioned to design part of the new coinage for the Commonwealth, and earlier in 1937 had become an invited foundation member of Robert Menzies' anti-modernist organisation, the Australian Academy of Art. Among his works is the emblem of the Holden Australian car company, a stylised 'Lion and Stone' symbol representing a legend of man's invention of the wheel. Architectural sculpture The ANZAC War Memorial, completed in 1934, is the main commemorative military monument in Sydney, designed by C. Bruce Dellit, has an exterior adorned with monumental figural reliefs and sculptures by Rayner Hoff, and is arguably the finest Art Deco structure in Australia. Medallions for various University of Sydney buildings, 1924 Royal Arch Masonic Temple, Sydney, Australia, 1927. More specifically the Egyptian Room in the Petersham Temple, he was a Freemason himself. The Spirit of Womanhood, National War Memorial, Adelaide, South Australia, 1927–30 Figures and panels, ANZAC War Memorial, Hyde Park, Sydney, Australia, 1931–34 Theatre Arts & Pan Liberty Theatre, Sydney, Australia, 1934 Ride of the Valkyries relief panel, Hotel Manly, Manly, Australia, 1935