They are impressively evolving so fast at Lux family @SakanaAILabs 

Latest: "Neural Attention Memory Models" that are evolved to optimize performance of transformers by pruning info in cache memory

NAMMs can then zero-shot transfer performance gains