I think uncertainty estimation/entropy sense is another good reason for multiple token prediction objective. Some pivots must be compositional, &gt;1 token. LLMs kind of look ahead by default, but if they're explicitly trained to do so they'll be better at noticing incoming slip-up