Kolbert spent her early childhood in the Bronx, New York; her family then relocated to Larchmont, New York, where she remained until 1979.
After graduating from Mamaroneck High School, Kolbert spent four years studying literature at Yale University.