PocketDoc commited on
Commit
52e4eeb
·
verified ·
1 Parent(s): 1e3e418

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +88 -1
README.md CHANGED
@@ -47,4 +47,91 @@ tags:
47
  - code
48
  - climate
49
  - text-generation-inference
50
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
  - code
48
  - climate
49
  - text-generation-inference
50
+ ---
51
+
52
+ ## What is it?
53
+
54
+ This model is intended to be multifarious in its capabilities and should be quite capable at both co-writing and roleplay as well as find itself quite at home performing sentiment analysis or summarization as part of a pipeline. It has been trained on a wide array of one shot instructions, multi turn instructions, role playing scenarios, text adventure games, co-writing, and much more. The full dataset is publicly available and can be found in the datasets section of the model page.
55
+
56
+ There has not been any form of harmfulness alignment done on this model, please take the aproppriate precautions when using it in a production environment.
57
+
58
+
59
+ ## Prompting
60
+
61
+ The model has been trained on standard "ChatML" format prompting, an example of which is shown below:
62
+
63
+ ```py
64
+ """<|im_start|>system
65
+ system prompt<|im_end|>
66
+ <|im_start|>user
67
+ Hi there!<|im_end|>
68
+ <|im_start|>assistant
69
+ Nice to meet you!<|im_end|>
70
+ <|im_start|>user
71
+ Can I ask a question?<|im_end|>
72
+ <|im_start|>assistant
73
+ """
74
+ ```
75
+
76
+
77
+ ## SillyTavern templates
78
+
79
+ Below are Instruct and Context templates for use within SillyTavern.
80
+
81
+ <details><summary>context template</summary>
82
+
83
+ ```yaml
84
+ {
85
+ "story_string": "<|im_start|>system\n{{#if system}}{{system}}\n{{/if}}{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{char}}'s personality: {{personality}}\n{{/if}}{{#if scenario}}Scenario: {{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}{{trim}}<|im_end|>\n",
86
+ "example_separator": "",
87
+ "chat_start": "",
88
+ "use_stop_strings": false,
89
+ "allow_jailbreak": false,
90
+ "always_force_name2": false,
91
+ "trim_sentences": false,
92
+ "include_newline": false,
93
+ "single_line": false,
94
+ "name": "Dan-ChatML"
95
+ }
96
+ ```
97
+
98
+ </details><br>
99
+ <details><summary>instruct template</summary>
100
+
101
+ ```yaml
102
+ {
103
+ "system_prompt": "Write {{char}}'s actions and dialogue, user will write {{user}}'s.",
104
+ "input_sequence": "<|im_start|>user\n",
105
+ "output_sequence": "<|im_start|>assistant\n",
106
+ "first_output_sequence": "",
107
+ "last_output_sequence": "",
108
+ "system_sequence_prefix": "",
109
+ "system_sequence_suffix": "",
110
+ "stop_sequence": "<|im_end|>",
111
+ "wrap": false,
112
+ "macro": true,
113
+ "names": false,
114
+ "names_force_groups": false,
115
+ "activation_regex": "",
116
+ "skip_examples": false,
117
+ "output_suffix": "<|im_end|>\n",
118
+ "input_suffix": "<|im_end|>\n",
119
+ "system_sequence": "<|im_start|>system\n",
120
+ "system_suffix": "<|im_end|>\n",
121
+ "user_alignment_message": "",
122
+ "last_system_sequence": "",
123
+ "system_same_as_user": false,
124
+ "first_input_sequence": "",
125
+ "last_input_sequence": "",
126
+ "name": "Dan-ChatML"
127
+ }
128
+ ```
129
+
130
+ </details><br>
131
+
132
+
133
+ ## Training
134
+
135
+ The training was done for 4 epochs on 8x H100 for approximately 21 hours.
136
+
137
+ [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)