After the Japanese attack on Hong Kong, the Japanese occupied the International Settlement in Shanghai.
In late 1945, after the end of the war, his mother returned to Britain with Ballard and his sister on the SS Arawa.