text: Underlying LLMs. In [47], Ong et al. trained the routers with GPT-4-1106-preview [14] as the strong model and Mixtral 
  8x7B [39] as the weak model. They report successful generalization between the underlying LLMs, stating that their 
  routers trained for a particular strong-weak LLM pair can be used with other strong-weak LLM pairs. 
  
  To allow our evaluation to scale, we use as the strong model Ms the open-sourced Llama-3.1-8B [3] and as Mw the 
  4-bit quantized version of Mixtral 8x7B (for efficiency reasons). This reduced the cost of our experiments by avoiding 
  expensive GPT API calls and lowering the computational costs of Mixtral. Unless mentioned otherwise, all of our results 
  
  7 