At first it was named the Pan Am Building , but in 1981 the Metropolitan Life Insurance Company bought the building from Pan Am and in 1991 they changed the name to the MetLife Building . Metropolitan Life Insurance Company bought the Pan Am Building from Pan Am in 1981 ; Pan Am 's headquarters remained in the building .