That is correct. 5 million USD would be a reasonable minimum budget for training  a large language model like GPT-3.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence