The invalid connection has a very low probability, and needs to be masked to be sure the score for valid connections remain the same and additional attention weight is not added for invalid connections.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence