After attending secondary school at Madras College in St Andrews, Brown graduated with a Master of Arts degree (1st Class Honours and the Duncan Medal) from the University of St Andrews (1963), a Doctor of Philosophy degree from the University of Newcastle upon Tyne (1966).
Brown accepted the Chair of Pure Mathematics at the University of New South Wales in 1975 when he and his family emigrated to Australia.