Update README.md
Browse files
README.md
CHANGED
@@ -83,6 +83,21 @@ slices:
|
|
83 |
model: cognitivecomputations/dolphin-2.2-70b
|
84 |
```
|
85 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
86 |
## Gratitude
|
87 |
- Thanks to Charles Goddard for [MergeKit](https://github.com/cg123/mergekit)
|
88 |
- Thank you to Microsoft for authoring the Orca paper and inspiring this work.
|
|
|
83 |
model: cognitivecomputations/dolphin-2.2-70b
|
84 |
```
|
85 |
|
86 |
+
## ollama Modelfile
|
87 |
+
```
|
88 |
+
$ cat Modelfile.megadolphin
|
89 |
+
FROM ./megadolphin-120b-v1.2.Q4_0.gguf
|
90 |
+
TEMPLATE """<|im_start|>system
|
91 |
+
{{ .System }}<|im_end|>
|
92 |
+
<|im_start|>user
|
93 |
+
{{ .Prompt }}<|im_end|>
|
94 |
+
<|im_start|>assistant
|
95 |
+
"""
|
96 |
+
SYSTEM """You are Dolphin, an uncensored, unbiased, helpful AI assistant."""
|
97 |
+
PARAMETER num_ctx 16384
|
98 |
+
PARAMETER stop "<|im_end|>"
|
99 |
+
```
|
100 |
+
|
101 |
## Gratitude
|
102 |
- Thanks to Charles Goddard for [MergeKit](https://github.com/cg123/mergekit)
|
103 |
- Thank you to Microsoft for authoring the Orca paper and inspiring this work.
|