Comparative analysis of the material criteria embedded in building sustainability assessment tools was performed. The material-related issues were identified, classified, and summarized. A framework, the triple bottom line of sustainability (environment, economy, and society), was used to examine the material assessment criteria, evaluation parameters, and descriptions. The material criteria were evaluated to identify the current features and weaknesses as balanced material assessments for sustainable development. The criteria showed significant differences in their scopes in covering the social and economic aspects beyond the environmental aspect. For comprehensive sustainability assessment purposes, it is essential that adequate attention be paid to all three dimensions. Finally, this paper proposes the indicators of the sustainable material assessment from an analysis of all the material-related items.