cl-trier commited on
Commit
409797e
·
1 Parent(s): e708a86

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +67 -0
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - rouge
8
+ model-index:
9
+ - name: flan-t5-small_twon-debug-generative-agent
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # flan-t5-small_twon-debug-generative-agent
17
+
18
+ This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 3.8511
21
+ - Rouge1: 9.4574
22
+ - Rouge2: 3.2143
23
+ - Rougel: 8.6333
24
+ - Rougelsum: 8.8052
25
+ - Gen Len: 18.99
26
+
27
+ ## Model description
28
+
29
+ More information needed
30
+
31
+ ## Intended uses & limitations
32
+
33
+ More information needed
34
+
35
+ ## Training and evaluation data
36
+
37
+ More information needed
38
+
39
+ ## Training procedure
40
+
41
+ ### Training hyperparameters
42
+
43
+ The following hyperparameters were used during training:
44
+ - learning_rate: 4e-05
45
+ - train_batch_size: 24
46
+ - eval_batch_size: 24
47
+ - seed: 42
48
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
+ - lr_scheduler_type: linear
50
+ - num_epochs: 5
51
+
52
+ ### Training results
53
+
54
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
+ |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
56
+ | 4.2488 | 1.19 | 100 | 3.9027 | 9.2555 | 2.9689 | 8.4655 | 8.5977 | 18.988 |
57
+ | 4.0882 | 2.38 | 200 | 3.8511 | 9.4574 | 3.2143 | 8.6333 | 8.8052 | 18.99 |
58
+ | 4.021 | 3.57 | 300 | 3.8275 | 9.132 | 3.1204 | 8.3109 | 8.5109 | 18.994 |
59
+ | 4.0126 | 4.76 | 400 | 3.8172 | 9.4354 | 3.1824 | 8.5889 | 8.7927 | 18.996 |
60
+
61
+
62
+ ### Framework versions
63
+
64
+ - Transformers 4.31.0
65
+ - Pytorch 2.0.1+cu117
66
+ - Datasets 2.14.3
67
+ - Tokenizers 0.13.3