jeffra commited on
Commit
64b9559
·
verified ·
1 Parent(s): 9c7e017

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -10,7 +10,7 @@ Snowflake’s AI research team introduces ExCoT, the first model in the Arctic T
10
 
11
  Based on our internal testing, ExCoT delivered state-of-the-art results on the [BIRD-test benchmark](https://bird-bench.github.io/), achieving best-in-class performance in the single-model, single-inference category using only public datasets (BIRD and Spider) and no additional Text2SQL data:
12
 
13
- * Arctic-ExCoT-70B (based on LLaMA 3.1 70B) improved execution accuracy on the BIRD-dev set from the base model’s 57.37% to 68.51%. Arctic-ExCoT-32B (based on Qwen-2.5-Coder 32B) achieved similarly strong gains.
14
 
15
  * Both models significantly outperformed larger open-weight models, such as Mistral 123B, and even proprietary systems including GPT-4o and Claude 3.5 — achieving over 12 percentage points of improvement.
16
 
 
10
 
11
  Based on our internal testing, ExCoT delivered state-of-the-art results on the [BIRD-test benchmark](https://bird-bench.github.io/), achieving best-in-class performance in the single-model, single-inference category using only public datasets (BIRD and Spider) and no additional Text2SQL data:
12
 
13
+ * [Llama-3.1-Arctic-ExCoT-70B](https://huggingface.co/Snowflake/Llama-3.1-Arctic-ExCoT-70B) improved execution accuracy on the BIRD-dev set from the base model’s 57.37% to 68.51%. [Qwen-2.5-coder-Arctic-ExCoT-32B](https://huggingface.co/Snowflake/Qwen-2.5-coder-Arctic-ExCoT-32B) achieved similarly strong gains.
14
 
15
  * Both models significantly outperformed larger open-weight models, such as Mistral 123B, and even proprietary systems including GPT-4o and Claude 3.5 — achieving over 12 percentage points of improvement.
16