Large language models in the market are undertrained! By quadrupling the training data, you could cut the compute budget by 4X. The trade-off? Make LLMs denser—GPT-3 - 175B parameters vs. GPT-4 - 1.76T parameters. #AI #LLM