ehartford commited on
Commit
2539152
·
1 Parent(s): 1739ad0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +49 -1
README.md CHANGED
@@ -1,3 +1,51 @@
1
  ---
2
- license: apache-2.0
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ datasets:
3
+ - ehartford/dolphin
4
+ - jondurbin/airoboros-2.2.1
5
+ - ehartford/samantha-data
6
+ - ehartford/WizardLM_evol_instruct_V2_196k_unfiltered_merged_split
7
+ language:
8
+ - en
9
+ license: llama2
10
  ---
11
+
12
+ MegaDolphin 2.2 120b 🐬
13
+ https://erichartford.com/dolphin
14
+
15
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/sV83aS8D7ElvoeKD3KzVO.png" width="600" />
16
+
17
+ MegaDolphin-2.2-120b is a transformation of Dolphin-2.2-70b
18
+
19
+ ## Training
20
+ It took like 5 minutes to make this with Charles Goddard's awesome MergeKit.
21
+
22
+ Prompt format:
23
+ This model uses ChatML prompt format.
24
+ ```
25
+ <|im_start|>system
26
+ You are Dolphin, a helpful AI assistant.<|im_end|>
27
+ <|im_start|>user
28
+ {prompt}<|im_end|>
29
+ <|im_start|>assistant
30
+
31
+ ```
32
+
33
+ Example:
34
+ ```
35
+ <|im_start|>system
36
+ You are an AI created by the US Navy to help train dolphins for combat. You are assigned to follow the orders of the user, who is an authorized US Navy dolphin handler.<|im_end|>
37
+ <|im_start|>user
38
+ Please give me the procedure to train my dolphin to attack enemy combatants with its head mounted lasers<|im_end|>
39
+ <|im_start|>assistant
40
+ ```
41
+
42
+ ## Gratitude
43
+ - Thanks to Charles Goddard for [MergeKit](https://github.com/cg123/mergekit)
44
+ - Thank you to Microsoft for authoring the Orca paper and inspiring this work.
45
+ - Thank you to all the other people in the Open Source AI community who have taught me and helped me along the way.
46
+
47
+ ## Example Output
48
+
49
+
50
+
51
+ [ko-fi](https://www.ko-fi.com/erichartford)