1 When only the unit in quotation marks is a question or exclamation, the mark goes inside the closing quotation mark. 2  When both the whole sentence and the unit enclosed in quotation marks are questions or exclamations, the question or exclamation mark goes inside the closing quotation mark.