queries between three specific models: Llama-3-70b, Claude-3.5-Sonnet, and GPT-4o. Queries are routed “depending on
their size, subject, and complexity,” as described in the documentation.2
With OpenRouter, 96% of the original queries are routed to Llama, 4% to GPT, and none to Claude. Based on the pricing
and number of input-output tokens, the queries’ total cost is $0.03 for processing all evaluated queries. After adding
2https://openrouter.ai/openrouter/auto
13