BERT does not "under- stand" negation and is insensitive to malformed input. BERT struggles with representations of num- bers. BERT cannot reason based on its world knowledge BERT struggles with pragmatic inference and role-based event knowledge