Transformer pros over LSTM:

- Parallelizable vs. sequential input processing (parallel is faster)
- Better at capturing long-range dependencies (via attention)
- Scale better (better for large models like GPT3)

LSTM pros over transformer:

- Require less memory (better for smaller computers)
- Require less training data (better for smaller models)
- Simpler (easier to implement)
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence