You can bet Meta’s Llama 4 will build further on what was learned.  Model inference efficiency is likely just getting started.  If I was a betting person,  I definitely wouldn’t assume that longterm most AI will be in a cloud.  More likely it will be multimodal device driven.