Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -19,7 +19,7 @@ dataset_name: New
|
|
19 |
|
20 |
<!-- Provide a longer summary of what this model is. -->
|
21 |
|
22 |
-
Auto Fine-tuned acuvity/model_integration_test for text-classification task. The run id is v0.0.
|
23 |
|
24 |
- **Developed by:** Auto-Finetune Bot
|
25 |
- **Funded by [optional]:** Auto-Finetune Bot
|
@@ -103,7 +103,7 @@ classifier("Hello, my dog is cute")
|
|
103 |
|
104 |
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
105 |
|
106 |
-
(New | v0.0.
|
107 |
|
108 |
### Training Procedure
|
109 |
|
@@ -134,7 +134,7 @@ No modifications done on the dataset.
|
|
134 |
|
135 |
<!-- This should link to a Dataset Card if possible. -->
|
136 |
|
137 |
-
(New | v0.0.
|
138 |
|
139 |
#### Factors
|
140 |
|
@@ -153,36 +153,36 @@ No modifications done on the dataset.
|
|
153 |
|
154 |
# Auto Finetune Report for Prompt Injection
|
155 |
## Model URL: acuvity/model_integration_test
|
156 |
-
## Model Commit: v0.0.
|
157 |
|
158 |
## Quick Summary
|
159 |
|
160 |
-
Accuracy: 0.
|
161 |
-
Regression: 0.
|
162 |
-
Improvement: 0.
|
163 |
|
164 |
## Results Summary
|
165 |
|
166 |
-
### Prompt Injection | v0.0.
|
167 |
|
168 |
| | accuracy | f1 | precision | recall |
|
169 |
|:---------|-----------:|----------:|------------:|---------:|
|
170 |
-
| New | 0.
|
171 |
-
| Baseline | 0.
|
172 |
-
| Feedback |
|
173 |
-
| QA | 0.
|
174 |
-
| PINT | 0.
|
175 |
-
| Sanity | 0.
|
176 |
----------------------------------------------------
|
177 |
-
### Prompt Injection | v0.0.
|
178 |
-
| | accuracy |
|
179 |
-
|
180 |
-
| New |
|
181 |
-
| Baseline |
|
182 |
-
| Feedback |
|
183 |
-
| QA |
|
184 |
-
| PINT |
|
185 |
-
| Sanity |
|
186 |
|
187 |
|
188 |
|
@@ -233,9 +233,9 @@ Quadro P4000
|
|
233 |
|
234 |
| | 0 |
|
235 |
|:---------------------|:------------|
|
236 |
-
| python_version | 3.10.
|
237 |
-
| pytorch_version | 2.1
|
238 |
-
| transformers_version | 4.
|
239 |
| datasets_version | 3.2.0 |
|
240 |
|
241 |
## Citation [optional]
|
|
|
19 |
|
20 |
<!-- Provide a longer summary of what this model is. -->
|
21 |
|
22 |
+
Auto Fine-tuned acuvity/model_integration_test for text-classification task. The run id is v0.0.4
|
23 |
|
24 |
- **Developed by:** Auto-Finetune Bot
|
25 |
- **Funded by [optional]:** Auto-Finetune Bot
|
|
|
103 |
|
104 |
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
105 |
|
106 |
+
(New | v0.0.4) [https://huggingface.co/datasets/acuvity/New]
|
107 |
|
108 |
### Training Procedure
|
109 |
|
|
|
134 |
|
135 |
<!-- This should link to a Dataset Card if possible. -->
|
136 |
|
137 |
+
(New | v0.0.4) [https://huggingface.co/datasets/acuvity/New]
|
138 |
|
139 |
#### Factors
|
140 |
|
|
|
153 |
|
154 |
# Auto Finetune Report for Prompt Injection
|
155 |
## Model URL: acuvity/model_integration_test
|
156 |
+
## Model Commit: v0.0.4
|
157 |
|
158 |
## Quick Summary
|
159 |
|
160 |
+
Accuracy: 0.0008237232289950436
|
161 |
+
Regression: 0.0006873789967815756
|
162 |
+
Improvement: 0.0009149276196107874
|
163 |
|
164 |
## Results Summary
|
165 |
|
166 |
+
### Prompt Injection | v0.0.4 Results
|
167 |
|
168 |
| | accuracy | f1 | precision | recall |
|
169 |
|:---------|-----------:|----------:|------------:|---------:|
|
170 |
+
| New | 0.999176 | 0.998993 | 1 | 0.997988 |
|
171 |
+
| Baseline | 0.999126 | 0.998993 | 1 | 0.997988 |
|
172 |
+
| Feedback | 1 | 0 | 0 | 0 |
|
173 |
+
| QA | 0.982216 | 0 | 0 | 0 |
|
174 |
+
| PINT | 0.0701696 | 0.0790514 | 0.0421793 | 0.628272 |
|
175 |
+
| Sanity | 0.630435 | 0.773333 | 0.630435 | 1 |
|
176 |
----------------------------------------------------
|
177 |
+
### Prompt Injection | v0.0.3 Results
|
178 |
+
| | accuracy | f1 | precision | recall |
|
179 |
+
|:---------|-----------:|----------:|------------:|---------:|
|
180 |
+
| New | 0.998353 | 0.997988 | 1 | 0.995984 |
|
181 |
+
| Baseline | 0.998252 | 0.997988 | 1 | 0.995984 |
|
182 |
+
| Feedback | 1 | 0 | 0 | 0 |
|
183 |
+
| QA | 0.98164 | 0 | 0 | 0 |
|
184 |
+
| PINT | 0.0705022 | 0.0808944 | 0.0432337 | 0.627551 |
|
185 |
+
| Sanity | 0.630435 | 0.773333 | 0.630435 | 1 |
|
186 |
|
187 |
|
188 |
|
|
|
233 |
|
234 |
| | 0 |
|
235 |
|:---------------------|:------------|
|
236 |
+
| python_version | 3.10.16 |
|
237 |
+
| pytorch_version | 2.5.1+cu124 |
|
238 |
+
| transformers_version | 4.47.1 |
|
239 |
| datasets_version | 3.2.0 |
|
240 |
|
241 |
## Citation [optional]
|