Tall buildings are ubiquitous in major cities and house the homes and workplaces of many individuals. However, relatively few studies have been carried out to study the dynamic characteristics of tall buildings based on field measurements. In this paper, the dynamic behavior of the Green Building, a unique 21-story tall structure located on the campus of the Massachusetts Institute of Technology (MIT, Cambridge, MA, USA), was characterized and modeled as a simplified lumped-mass beam model (SLMM), using data from a network of accelerometers. The accelerometer network was used to record structural responses due to ambient vibrations, blast loading, and the October 16th 2012 earthquake near Hollis Center (ME, USA). Spectral and signal coherence analysis of the collected data was used to identify natural frequencies, modes, foundation rocking behavior, and structural asymmetries. A relation between foundation rocking and structural natural frequencies was also found. Natural frequencies and structural acceleration from the field measurements were compared with those predicted by the SLMM which was updated by inverse solving based on advanced multiobjective optimization methods using the measured structural responses and found to have good agreement.