chat
lucyknada commited on
Commit
428b93f
·
verified ·
1 Parent(s): 6d434ae

Upload ./README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +45 -0
README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
+ ---
9
+ ### exl2 quant (measurement.json in main branch)
10
+ ---
11
+ ### check revisions for quants
12
+ ---
13
+
14
+ # outputs
15
+
16
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
+
18
+ ## Merge Details
19
+ ### Merge Method
20
+
21
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using /home/mango/Trainers/mergekit/mergekit/models + /home/mango/Trainers/mergekit/mergekit/models/lora as a base.
22
+
23
+ ### Models Merged
24
+
25
+ The following models were included in the merge:
26
+
27
+
28
+ ### Configuration
29
+
30
+ The following YAML configuration was used to produce this model:
31
+
32
+ ```yaml
33
+ base_model: /home/mango/Trainers/mergekit/mergekit/models+/home/mango/Trainers/mergekit/mergekit/models/lora
34
+ dtype: bfloat16
35
+ merge_method: task_arithmetic
36
+ parameters:
37
+ normalize: false
38
+ slices:
39
+ - sources:
40
+ - layer_range: [0, 32]
41
+ model: /home/mango/Trainers/mergekit/mergekit/models+/home/mango/Trainers/mergekit/mergekit/models/lora
42
+ parameters:
43
+ weight: 1.0
44
+
45
+ ```