Brownlee and his wife had two sons: John Edy Brownlee was born December 1915, and Alan Marshall Brownlee was born September 1917.
Although Brownlee's public image was of a severe and humourless technocrat, in private he allowed himself some levity.