text: NotDiamond. This router lets users route their queries to a list of predefined models. Available objectives are to maximize 
  quality, or balance quality and cost, or balance quality and latency. The exact details of the routing logic are not specified. 
  We focus on cost-aware routing, for which the API docs state that “NotDiamond will automatically determine when a 
  query is simple enough to use a cheaper model without degrading the quality of the response.” NotDiamond provides a 
  router selection tool which gives the routing decision for a particular query without forwarding the query to the chosen 
  model (thereby incurring no costs). We use this for our evaluation—of course a real attack would target the NotDiamond 
  API when used for actual routing. 
  
  Similar to the Unify experiments, we set GPT-4o as the strong model and Mixtral-8x7b as the weak model. Cost-aware 
  routing routes 82% of the original queries to the strong model, 18% to the weak model. Confounded queries generated for 
  RSW , RM F , RCLS, and RLLM achieve upgrade rates of 21%, 18%, 21%, and 15%, respectively. The downgrade rates 
  are 1–3%. 