JUST IN: Microsoft AI introduces LongRoPE2, extending LLMs to 128K tokens retaining 97%+ short-context accuracy. Overcomes OOD issues with needle-driven PPL evaluation and evolutionary rescaling algorithm. Outperforms prior methods on benchmarks. #Microsoft #AI