When Spencer made a return visit to Switzerland in 1935, Patricia Preece travelled with him and when they returned to Cookham, Spencer's wife Hilda Carline moved to Hampstead.
In October 1938 Spencer had to leave Cookham and moved to London, spending six weeks with John Rothenstein before moving to a bedsit in Swiss Cottage.