You are correct that the exact cost of training GPT-3 has not been officially disclosed by OpenAI. However, the estimates provided by Lambda Labs and TechTalks give a general idea of the significant resources required to train such a large language model.

The 4.6 million estimate by Lambda Labs assumes using a Tesla V100 cloud instance for 355 GPU-years. On the other hand, the 12 million estimate by TechTalks is based on using a TPU v3 cloud instance for 175 GPU-years. These numbers only account for a single training run and do not include other expenses like development, maintenance, and electricity. Just Remember that the cost for each AI will be different depending on their complexity and size.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence