unknown
commited on
Commit
·
35a3aa3
1
Parent(s):
2d001b6
add files
Browse files
README.md
CHANGED
@@ -113,7 +113,7 @@ This repository contains all fine-tuned models for experiments with ComBack.
|
|
113 |
| Model | EM | ED | EM | ED | EM | ED | EM | ED | EM | ED | EM | ED | BLEU4 | ED | BLEU4 | ED | BLEU4 | ED |
|
114 |
| ChatGPT-3.5-Turbo | 12.08 | 41.39 | 16.77 | 42.02 | 14.73 | 43.72 | 9.80 | 21.86 | 10.81 | 20.66 | 11.39 | 22.82 | 9.24 | 32.13 | 11.96 | 35.33 | 10.07 | 32.90 |
|
115 |
| Code-LLaMA-34B | 0.45 | 17.61 | 0.61 | 17.21 | 0.99 | 17.23 | 1.75 | 15.04 | 0.42 | 11.27 | 2.42 | 16.25 | 6.92 | 32.54 | 8.95 | 38.22 | 8.20 | 34.16 |
|
116 |
-
| CodeT5+-220m | **62.68** | **82.02** | **71.34** | **85.98** | **64.45** | **81.53** | **48.71** | **68.95** | **58.68** | **74.57** | **47.81** | **65.5** | **50.34** | **72.98** | **55.38** | **74.41** | **
|
117 |
|
118 |
|
119 |
|
|
|
113 |
| Model | EM | ED | EM | ED | EM | ED | EM | ED | EM | ED | EM | ED | BLEU4 | ED | BLEU4 | ED | BLEU4 | ED |
|
114 |
| ChatGPT-3.5-Turbo | 12.08 | 41.39 | 16.77 | 42.02 | 14.73 | 43.72 | 9.80 | 21.86 | 10.81 | 20.66 | 11.39 | 22.82 | 9.24 | 32.13 | 11.96 | 35.33 | 10.07 | 32.90 |
|
115 |
| Code-LLaMA-34B | 0.45 | 17.61 | 0.61 | 17.21 | 0.99 | 17.23 | 1.75 | 15.04 | 0.42 | 11.27 | 2.42 | 16.25 | 6.92 | 32.54 | 8.95 | 38.22 | 8.20 | 34.16 |
|
116 |
+
| CodeT5+-220m | **62.68** | **82.02** | **71.34** | **85.98** | **64.45** | **81.53** | **48.71** | **68.95** | **58.68** | **74.57** | **47.81** | **65.5** | **50.34** | **72.98** | **55.38** | **74.41** | **44.33** | **66.36** |
|
117 |
|
118 |
|
119 |
|