Brown received his bachelor's degree in physics in 1946 from the University of Wisconsin and in 1948 his master's degree from Yale University, where in 1950 he earned his PhD.
Brown worked first in theoretical atomic physics (self-ionization of the vacuum with Geoff Ravenhall in 1951, Lamb shift in heavy atoms, electron-electron interactions, precise calculation of Rayleigh scattering).