lucienbaumgartner/mtg-spike-multilabel-distilbert

README.md

@@ -18,11 +18,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2704
-- F1 Micro: 0.6957
-- F1 Macro: 0.6938
-- F1 Weighted: 0.6942
-- Accuracy: 0.6288
+- Loss: 0.2725
+- F1 Micro: 0.6677
+- F1 Macro: 0.6644
+- F1 Weighted: 0.6651
+- Accuracy: 0.5900
 
 ## Model description
 
@@ -53,16 +53,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | F1 Micro | F1 Macro | F1 Weighted | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:-----------:|:--------:|
-| No log        | 1.0   | 406  | 0.3799          | 0.0741   | 0.0712   | 0.0715      | 0.1468   |
-| 0.4142        | 2.0   | 812  | 0.2767          | 0.5943   | 0.5891   | 0.5903      | 0.4986   |
-| 0.253         | 3.0   | 1218 | 0.2743          | 0.6603   | 0.6510   | 0.6523      | 0.5734   |
-| 0.2016        | 4.0   | 1624 | 0.2716          | 0.6656   | 0.6601   | 0.6611      | 0.5873   |
-| 0.1857        | 5.0   | 2030 | 0.2704          | 0.6957   | 0.6938   | 0.6942      | 0.6288   |
-| 0.1857        | 6.0   | 2436 | 0.2712          | 0.6862   | 0.6854   | 0.6858      | 0.6233   |
-| 0.1636        | 7.0   | 2842 | 0.2790          | 0.7011   | 0.6999   | 0.7004      | 0.6399   |
-| 0.1544        | 8.0   | 3248 | 0.2754          | 0.7068   | 0.7065   | 0.7068      | 0.6510   |
-| 0.1455        | 9.0   | 3654 | 0.2769          | 0.7087   | 0.7082   | 0.7085      | 0.6482   |
-| 0.1424        | 10.0  | 4060 | 0.2781          | 0.7096   | 0.7089   | 0.7092      | 0.6510   |
+| No log        | 1.0   | 406  | 0.3793          | 0.0637   | 0.0619   | 0.0621      | 0.1413   |
+| 0.4136        | 2.0   | 812  | 0.2789          | 0.6272   | 0.6225   | 0.6236      | 0.5346   |
+| 0.2499        | 3.0   | 1218 | 0.2725          | 0.6677   | 0.6644   | 0.6651      | 0.5900   |
+| 0.2017        | 4.0   | 1624 | 0.2744          | 0.675    | 0.6716   | 0.6721      | 0.6066   |
+| 0.1853        | 5.0   | 2030 | 0.2745          | 0.6833   | 0.6797   | 0.6805      | 0.6122   |
+| 0.1853        | 6.0   | 2436 | 0.2771          | 0.6781   | 0.6764   | 0.6770      | 0.6177   |
+| 0.1621        | 7.0   | 2842 | 0.2810          | 0.6980   | 0.6962   | 0.6970      | 0.6343   |
+| 0.1536        | 8.0   | 3248 | 0.2832          | 0.6998   | 0.6982   | 0.6988      | 0.6427   |
+| 0.1414        | 9.0   | 3654 | 0.2843          | 0.6958   | 0.6943   | 0.6948      | 0.6371   |
+| 0.1429        | 10.0  | 4060 | 0.2861          | 0.6928   | 0.6905   | 0.6911      | 0.6316   |
 
 
 ### Framework versions

adapter_config.json

@@ -23,9 +23,9 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_lin",
+    "k_lin",
     "q_lin",
-    "k_lin"
+    "v_lin"
   ],
   "task_type": "SEQ_CLS",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:313120a73de8d836ed235ec930b762c6d4aee2fee14833b884a9a2956f9353d0
+oid sha256:fc2b79c7c7e1776dd36435599df64235f55157a32251b2365f97e16f18c391f5
 size 3268052

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f535e62a370b67527208c18429db1c62c22fbdd074794eca5d3033acfb068356
+oid sha256:f2eec190de3be7f73fd8d2283985f321e126a0390082058003f1f469b1cced0d
 size 4728