We are releasing our code base for TxT360, a globally deduplicated dataset for LLM pretraining:

🌐(You can access the full dataset here:We are happy to see the open source community filled with great recent dataset releases, including FineWeb 2 (@huggingface), Tülu 3 Data (@allen_ai), FineFineWeb (M-A-P), and more.