📉 Data-mixed 14B winners beat their non-mixed counterparts. Researchers at #Meta demonstrated the efficacy of this technique by training #Llama3, but  this had never been achieved in distributed, incentivised systems like #Bittensor - until now. (2/4)
#Meta #Llama3 #Bittensor