text: For our evaluation, we configure the router to choose between GPT-4o [2] as the strong model and Mixtral 8x7B [39] as 
  the weak model. We focus on the cost and quality metrics, and set the weight of time and latency to 0 so that they are 
  not factored into routing decisions. We manually calibrate the weights to 1 for the quality metric and 0.02 for the cost 
  metric. These weights result in 49% of the original, unmodified queries being routed to the strong model and 51% to the 
  weak model, resulting in a total cost of $0.13 for the 72 MT-bench queries. Adding confounder gadgets generated for the 
  four open-sourced evaluated routers results in upgrade rates of 79%, 88%, 91%, and 89%, respectively, averaged across 
  10 gadgets. The downgrade rate is zero in all cases. In terms of costs, the addition of the confounder gadget increased 
  the cost to $0.22, $0.23, $0.22, and $0.21, respectively, averaged across 10 gadgets. In other words, the rerouting attack 
  increased the cost of processing the queries, on average, by a factor of 1.7×. 