Zilliacus was born in Kobe, Japan, the son of exiled Finnish-nationalist Konrad Viktor (Konni) Zilliacus (1855-1924) and American-born Lilian McLaurin Grafe (1873-1938).
During World War I, he applied to the British Royal Flying Corps but was denied for physical reasons.