Hugging Face's logo

lucienbaumgartner
/
PAG-annotation

Text Classification
setfit
Safetensors
sentence-transformers
mpnet
generated_from_setfit_trainer
Eval Results
Model card Files Community
lucienbaumgartner commited on
Commit
1758f02
·
verified ·
1 Parent(s): 12dc012

Add SetFit model

Browse files
Files changed (4) hide show
  1. README.md +25 -25
  2. config.json +1 -1
  3. model.safetensors +1 -1
  4. model_head.pkl +1 -1
README.md CHANGED
@@ -9,11 +9,12 @@ base_model: sentence-transformers/all-mpnet-base-v2
9
  metrics:
10
  - accuracy
11
  widget:
12
- - text: Warm thanks to the volunteers who dedicated their time this weekend.
13
- - text: Hats off to the design team.
14
- - text: It means the world to me that you were there when I needed a friend.
15
- - text: How heartwarming it is to see communities come together in times of need.
16
  - text: Well done on orchestrating such a seamless event!
 
17
  pipeline_tag: text-classification
18
  inference: false
19
  model-index:
@@ -28,7 +29,7 @@ model-index:
28
  split: test
29
  metrics:
30
  - type: accuracy
31
- value: 0.42857142857142855
32
  name: Accuracy
33
  ---
34
 
@@ -64,7 +65,7 @@ The model has been trained using an efficient few-shot learning technique that i
64
  ### Metrics
65
  | Label | Accuracy |
66
  |:--------|:---------|
67
- | **all** | 0.4286 |
68
 
69
  ## Uses
70
 
@@ -84,7 +85,7 @@ from setfit import SetFitModel
84
  # Download from the 🤗 Hub
85
  model = SetFitModel.from_pretrained("setfit_model_id")
86
  # Run inference
87
- preds = model("Hats off to the design team.")
88
  ```
89
 
90
  <!--
@@ -114,12 +115,12 @@ preds = model("Hats off to the design team.")
114
  ## Training Details
115
 
116
  ### Training Set Metrics
117
- | Training set | Min | Median | Max |
118
- |:-------------|:----|:--------|:----|
119
- | Word count | 6 | 10.6667 | 16 |
120
 
121
  ### Training Hyperparameters
122
- - batch_size: (16, 2)
123
  - num_epochs: (10, 10)
124
  - max_steps: -1
125
  - sampling_strategy: oversampling
@@ -138,20 +139,19 @@ preds = model("Hats off to the design team.")
138
  ### Training Results
139
  | Epoch | Step | Training Loss | Validation Loss |
140
  |:-------:|:------:|:-------------:|:---------------:|
141
- | 0.0556 | 1 | 0.3495 | - |
142
- | 1.0 | 18 | - | 0.2242 |
143
- | **2.0** | **36** | **-** | **0.1868** |
144
- | 2.7778 | 50 | 0.0636 | - |
145
- | 3.0 | 54 | - | 0.2124 |
146
- | 4.0 | 72 | - | 0.213 |
147
- | 5.0 | 90 | - | 0.2202 |
148
- | 5.5556 | 100 | 0.0661 | - |
149
- | 6.0 | 108 | - | 0.228 |
150
- | 7.0 | 126 | - | 0.2306 |
151
- | 8.0 | 144 | - | 0.2352 |
152
- | 8.3333 | 150 | 0.0318 | - |
153
- | 9.0 | 162 | - | 0.2368 |
154
- | 10.0 | 180 | - | 0.2372 |
155
 
156
  * The bold row denotes the saved checkpoint.
157
  ### Framework Versions
 
9
  metrics:
10
  - accuracy
11
  widget:
12
+ - text: I appreciate the smooth operation of our public transit system every day.
13
+ - text: Precision shines through in your flawless execution of the project.
14
+ - text: Your assistance with the move was invaluable; I couldn’t have managed without
15
+ you.
16
  - text: Well done on orchestrating such a seamless event!
17
+ - text: The presentation Anne gave was remarkably insightful and comprehensive.
18
  pipeline_tag: text-classification
19
  inference: false
20
  model-index:
 
29
  split: test
30
  metrics:
31
  - type: accuracy
32
+ value: 0.5
33
  name: Accuracy
34
  ---
35
 
 
65
  ### Metrics
66
  | Label | Accuracy |
67
  |:--------|:---------|
68
+ | **all** | 0.5 |
69
 
70
  ## Uses
71
 
 
85
  # Download from the 🤗 Hub
86
  model = SetFitModel.from_pretrained("setfit_model_id")
87
  # Run inference
88
+ preds = model("Well done on orchestrating such a seamless event!")
89
  ```
90
 
91
  <!--
 
115
  ## Training Details
116
 
117
  ### Training Set Metrics
118
+ | Training set | Min | Median | Max |
119
+ |:-------------|:----|:-------|:----|
120
+ | Word count | 6 | 10.75 | 16 |
121
 
122
  ### Training Hyperparameters
123
+ - batch_size: (32, 2)
124
  - num_epochs: (10, 10)
125
  - max_steps: -1
126
  - sampling_strategy: oversampling
 
139
  ### Training Results
140
  | Epoch | Step | Training Loss | Validation Loss |
141
  |:-------:|:------:|:-------------:|:---------------:|
142
+ | 0.0769 | 1 | 0.3115 | - |
143
+ | 1.0 | 13 | - | 0.1928 |
144
+ | 2.0 | 26 | - | 0.1831 |
145
+ | 3.0 | 39 | - | 0.1724 |
146
+ | 3.8462 | 50 | 0.08 | - |
147
+ | **4.0** | **52** | **-** | **0.1614** |
148
+ | 5.0 | 65 | - | 0.1695 |
149
+ | 6.0 | 78 | - | 0.1837 |
150
+ | 7.0 | 91 | - | 0.1904 |
151
+ | 7.6923 | 100 | 0.0364 | - |
152
+ | 8.0 | 104 | - | 0.1997 |
153
+ | 9.0 | 117 | - | 0.1994 |
154
+ | 10.0 | 130 | - | 0.1967 |
 
155
 
156
  * The bold row denotes the saved checkpoint.
157
  ### Framework Versions
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "checkpoints/step_36",
3
  "architectures": [
4
  "MPNetModel"
5
  ],
 
1
  {
2
+ "_name_or_path": "checkpoints/step_52",
3
  "architectures": [
4
  "MPNetModel"
5
  ],
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f5fc33f86dce158903b65d830c5f12cbceb4dc68e1ec3139f2b8d5ac532c2d80
3
  size 437967672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adeb11e86a9226a054dde6ce61154ae78d3c63ea9ddb705b9a82f8efaf3e85c0
3
  size 437967672
model_head.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5e9c79beaa41bf2546e6d75687d1336f7046f8d9f008ae7b4548dddcaee5a6ac
3
  size 20321
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb4a562dd262d1041a045f499daaf0d1c9010083ee0e4841c86e88870b5c4695
3
  size 20321