Born in Hartford, Connecticut, Bremer was educated at New Canaan Country School, and Phillips Andover Academy.
Bremer graduated from Yale University in 1963 and went on to earn an MBA from Harvard University in 1966.