metadata

license: apache-2.0
base_model: google/flan-t5-small
tags:
  - generated_from_trainer
model-index:
  - name: t5-dialogue-classification-4
    results: []

t5-dialogue-classification-4

This model is a fine-tuned version of google/flan-t5-small on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.4724
Classification Report: precision recall f1-score support
```
ALLERGY     1.0000    0.5000    0.6667         4
```
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8095 0.8500 0.8293 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1

IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7200       100
macro avg     0.4496    0.4786    0.4374       100

weighted avg 0.6919 0.7200 0.6891 100

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 7
eval_batch_size: 7
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Classification Report
No log	1.0	172	0.5916	precision recall f1-score support

  ALLERGY     0.6667    0.5000    0.5714         4

ASSESSMENT 0.0000 0.0000 0.0000 4 Afib 0.0000 0.0000 0.0000 0 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.7308 0.8636 0.7917 22 GENHX 0.4000 1.0000 0.5714 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 1.0000 0.1429 0.2500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.4286 0.7500 0.5455 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11

 accuracy                         0.4800       100
macro avg     0.1536    0.1551    0.1300       100

weighted avg 0.3717 0.4800 0.3724 100 | | No log | 2.0 | 344 | 0.3963 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.1667 0.5000 0.2500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8077 0.9545 0.8750 22 GENHX 0.7200 0.9000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5556 0.7143 0.6250 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.2000 0.7500 0.3158 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6100       100
macro avg     0.3058    0.2750    0.2476       100

weighted avg 0.6086 0.6100 0.5623 100 | | 0.6305 | 3.0 | 516 | 0.3808 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3333 0.7500 0.4615 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.7857 1.0000 0.8800 22 GENHX 0.7826 0.9000 0.8372 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5556 0.7143 0.6250 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11

 accuracy                         0.6600       100
macro avg     0.3273    0.3489    0.3108       100

weighted avg 0.6067 0.6600 0.6024 100 | | 0.6305 | 4.0 | 688 | 0.3441 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2727 0.7500 0.4000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8182 0.9000 0.8571 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 1.0000 0.5000 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.6800       100
macro avg     0.3032    0.3603    0.3005       100

weighted avg 0.6217 0.6800 0.6255 100 | | 0.6305 | 5.0 | 860 | 0.3423 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 0.5000 0.2500 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.8095 0.8500 0.8293 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3077 1.0000 0.4706 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7000       100
macro avg     0.3440    0.3975    0.3477       100

weighted avg 0.6587 0.7000 0.6624 100 | | 0.1584 | 6.0 | 1032 | 0.3373 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8889 0.8000 0.8421 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 1.0000 0.5000 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8889 0.7273 0.8000 11

 accuracy                         0.6800       100
macro avg     0.3605    0.4098    0.3546       100

weighted avg 0.6548 0.6800 0.6458 100 | | 0.1584 | 7.0 | 1204 | 0.3611 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.2500 1.0000 0.4000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8889 0.8000 0.8421 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 1.0000 0.5000 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8889 0.7273 0.8000 11

 accuracy                         0.7000       100
macro avg     0.4045    0.4390    0.3855       100

weighted avg 0.6860 0.7000 0.6706 100 | | 0.1584 | 8.0 | 1376 | 0.3677 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.2000 1.0000 0.3333 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.7391 0.8500 0.7907 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 0.7143 0.7692 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.7273 1.0000 0.8421 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11

 accuracy                         0.7000       100
macro avg     0.4335    0.4449    0.3987       100

weighted avg 0.7025 0.7000 0.6729 100 | | 0.098 | 9.0 | 1548 | 0.3759 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.3333 0.3333 0.3333 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.8421 0.8000 0.8205 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8889 0.7273 0.8000 11

 accuracy                         0.7200       100
macro avg     0.4103    0.4628    0.4152       100

weighted avg 0.6932 0.7200 0.6932 100 | | 0.098 | 10.0 | 1720 | 0.3918 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8947 0.8500 0.8718 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5714 0.5714 0.5714 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8889 0.7273 0.8000 11

 accuracy                         0.7100       100
macro avg     0.4089    0.4593    0.4104       100

weighted avg 0.6909 0.7100 0.6861 100 | | 0.098 | 11.0 | 1892 | 0.3808 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2000 0.5000 0.2857 2 EDCOURSE 0.5000 0.3333 0.4000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.8095 0.8500 0.8293 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7273 0.7619 11

 accuracy                         0.7500       100
macro avg     0.4545    0.4926    0.4534       100

weighted avg 0.7110 0.7500 0.7175 100 | | 0.0648 | 12.0 | 2064 | 0.3998 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.5000 0.3333 0.4000 3 EDITION 0.0000 0.0000 0.0000 0 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.8947 0.8500 0.8718 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7273 0.7619 11

 accuracy                         0.7400       100
macro avg     0.4340    0.4760    0.4362       100

weighted avg 0.7262 0.7400 0.7200 100 | | 0.0648 | 13.0 | 2236 | 0.4352 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7391 0.8500 0.7907 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7100       100
macro avg     0.4528    0.4619    0.4348       100

weighted avg 0.6862 0.7100 0.6820 100 | | 0.0648 | 14.0 | 2408 | 0.4611 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8947 0.8500 0.8718 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7200       100
macro avg     0.4336    0.4786    0.4368       100

weighted avg 0.6978 0.7200 0.6938 100 | | 0.0475 | 15.0 | 2580 | 0.4470 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7727 0.8500 0.8095 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.6667 0.5714 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7200       100
macro avg     0.4452    0.4786    0.4368       100

weighted avg 0.6905 0.7200 0.6899 100 | | 0.0475 | 16.0 | 2752 | 0.4607 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.8500 0.8500 0.8500 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7300       100
macro avg     0.4501    0.4809    0.4388       100

weighted avg 0.7000 0.7300 0.6977 100 | | 0.0475 | 17.0 | 2924 | 0.4592 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.9444 0.8500 0.8947 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.7500 1.0000 0.8571 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7300       100
macro avg     0.4416    0.4953    0.4493       100

weighted avg 0.7113 0.7300 0.7056 100 | | 0.0323 | 18.0 | 3096 | 0.4671 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8947 0.8500 0.8718 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.7500 1.0000 0.8571 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7300       100
macro avg     0.4312    0.4953    0.4399       100

weighted avg 0.7001 0.7300 0.6994 100 | | 0.0323 | 19.0 | 3268 | 0.4689 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8095 0.8500 0.8293 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7200       100
macro avg     0.4469    0.4786    0.4369       100

weighted avg 0.6871 0.7200 0.6873 100 | | 0.0323 | 20.0 | 3440 | 0.4724 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8095 0.8500 0.8293 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7200       100
macro avg     0.4496    0.4786    0.4374       100

weighted avg 0.6919 0.7200 0.6891 100 |

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu121
Datasets 2.16.1
Tokenizers 0.15.0