Update README.md
Browse files
README.md
CHANGED
@@ -1,29 +1,46 @@
|
|
1 |
---
|
2 |
license: llama3.1
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
language:
|
4 |
- en
|
5 |
base_model:
|
6 |
-
- meta-llama/Llama-3.1-8B
|
7 |
---
|
8 |
|
9 |
-
# Dolphin Llama 3.1 8B
|
|
|
|
|
|
|
10 |
|
11 |
[](https://discord.gg/cognitivecomputations)
|
12 |
Discord: https://discord.gg/cognitivecomputations
|
13 |
|
14 |
-
<img src="https://
|
15 |
|
16 |
## Sponsors
|
17 |
-
Our appreciation for the generous sponsors of Dolphin:
|
18 |
- [Crusoe Cloud](https://crusoe.ai/) - provided 16x L40s for training and evals
|
19 |
- [Akash](https://akash.network/) - provided on-demand 8x H100 for training
|
20 |
- [Lazarus](https://www.lazarusai.com/) - provided 16x H100 for training
|
21 |
- [Cerebras](https://cerebras.ai/) - provided excellent and fast inference services for data labeling
|
22 |
- [Andreessen Horowitz](https://a16z.com/) - provided a [grant](https://a16z.com/supporting-the-open-source-ai-community/) that make Dolphin 1.0 possible and enabled me to bootstrap my homelab
|
23 |
|
24 |
-
## What is Dolphin
|
25 |
|
26 |
-
Dolphin
|
27 |
|
28 |
Dolphin aims to be a general purpose model, similar to the models behind ChatGPT, Claude, Gemini. But these models present problems for businesses seeking to include AI in their products.
|
29 |
1) They maintain control of the system prompt, deprecating and changing things as they wish, often causing software to break.
|
@@ -39,7 +56,15 @@ https://erichartford.com/uncensored-models
|
|
39 |
|
40 |
## Chat Template
|
41 |
|
42 |
-
We
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
43 |
|
44 |
## System Prompt
|
45 |
|
@@ -59,7 +84,9 @@ Please implement A* using python<|im_end|>
|
|
59 |
|
60 |
## Sample Outputs
|
61 |
|
62 |
-
|
|
|
|
|
63 |
|
64 |
## How to use
|
65 |
|
@@ -71,6 +98,29 @@ There are many ways to use a huggingface model including:
|
|
71 |
- sglang
|
72 |
- tgi
|
73 |
|
|
|
|
|
|
|
|
|
|
|
74 |
## Evals
|
75 |
|
76 |
-
TBD
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: llama3.1
|
3 |
+
datasets:
|
4 |
+
- OpenCoder-LLM/opc-sft-stage1
|
5 |
+
- OpenCoder-LLM/opc-sft-stage2
|
6 |
+
- microsoft/orca-agentinstruct-1M-v1
|
7 |
+
- microsoft/orca-math-word-problems-200k
|
8 |
+
- NousResearch/hermes-function-calling-v1
|
9 |
+
- AI-MO/NuminaMath-CoT
|
10 |
+
- AI-MO/NuminaMath-TIR
|
11 |
+
- allenai/tulu-3-sft-mixture
|
12 |
+
- cognitivecomputations/dolphin-coder
|
13 |
+
- HuggingFaceTB/smoltalk
|
14 |
+
- cognitivecomputations/samantha-data
|
15 |
+
- m-a-p/CodeFeedback-Filtered-Instruction
|
16 |
+
- m-a-p/Code-Feedback
|
17 |
language:
|
18 |
- en
|
19 |
base_model:
|
20 |
+
- meta-llama/Llama-3.1-8B
|
21 |
---
|
22 |
|
23 |
+
# Dolphin 3.0 Llama 3.1 8B 🐬
|
24 |
+
Part of the [Dolphin 3.0 Collection](https://huggingface.co/collections/cognitivecomputations/dolphin-30-677ab47f73d7ff66743979a3)
|
25 |
+
|
26 |
+
Curated and trained by [Eric Hartford](https://huggingface.co/ehartford), [Ben Gitter](https://huggingface.co/bigstorm), [BlouseJury](https://huggingface.co/BlouseJury) and [Cognitive Computations](https://huggingface.co/cognitivecomputations)
|
27 |
|
28 |
[](https://discord.gg/cognitivecomputations)
|
29 |
Discord: https://discord.gg/cognitivecomputations
|
30 |
|
31 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/cNCs1TBD3FelWCJGkZ3cd.png" width="600" />
|
32 |
|
33 |
## Sponsors
|
34 |
+
Our appreciation for the generous sponsors of Dolphin 3.0:
|
35 |
- [Crusoe Cloud](https://crusoe.ai/) - provided 16x L40s for training and evals
|
36 |
- [Akash](https://akash.network/) - provided on-demand 8x H100 for training
|
37 |
- [Lazarus](https://www.lazarusai.com/) - provided 16x H100 for training
|
38 |
- [Cerebras](https://cerebras.ai/) - provided excellent and fast inference services for data labeling
|
39 |
- [Andreessen Horowitz](https://a16z.com/) - provided a [grant](https://a16z.com/supporting-the-open-source-ai-community/) that make Dolphin 1.0 possible and enabled me to bootstrap my homelab
|
40 |
|
41 |
+
## What is Dolphin?
|
42 |
|
43 |
+
Dolphin 3.0 is the next generation of the Dolphin series of instruct-tuned models. Designed to be the ultimate general purpose local model, enabling coding, math, agentic, function calling, and general use cases.
|
44 |
|
45 |
Dolphin aims to be a general purpose model, similar to the models behind ChatGPT, Claude, Gemini. But these models present problems for businesses seeking to include AI in their products.
|
46 |
1) They maintain control of the system prompt, deprecating and changing things as they wish, often causing software to break.
|
|
|
56 |
|
57 |
## Chat Template
|
58 |
|
59 |
+
We use ChatML for the chat template.
|
60 |
+
|
61 |
+
```
|
62 |
+
<|im_start|>system
|
63 |
+
You are Dolphin, a helpful AI assistant.<|im_end|>
|
64 |
+
<|im_start|>user
|
65 |
+
{prompt}<|im_end|>
|
66 |
+
<|im_start|>assistant
|
67 |
+
```
|
68 |
|
69 |
## System Prompt
|
70 |
|
|
|
84 |
|
85 |
## Sample Outputs
|
86 |
|
87 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/C-r1X13UBjnUUNb0q2JLV.png" width="600" />
|
88 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/4l3KAZiKej2ON7i35PsOa.png" width="600" />
|
89 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/1ZalmR66LnwhEQQEFttlu.png" width="600" />
|
90 |
|
91 |
## How to use
|
92 |
|
|
|
98 |
- sglang
|
99 |
- tgi
|
100 |
|
101 |
+
### ollama
|
102 |
+
- [Install ollama](https://ollama.com/download)
|
103 |
+
- ```ollama run hf.co/cognitivecomputations/Dolphin3.0-Llama3.1-8B-GGUF:Q4_0```
|
104 |
+
- ```/set system <your system prompt>```
|
105 |
+
|
106 |
## Evals
|
107 |
|
108 |
+
TBD
|
109 |
+
|
110 |
+
## Appreciation
|
111 |
+
|
112 |
+
Respect and thanks to the creators of the open source datasets that were used:
|
113 |
+
- [OpenCoder-LLM](https://huggingface.co/OpenCoder-LLM) (opc-sft-stage1, opc-sft-stage2)
|
114 |
+
- [microsoft](https://huggingface.co/OpenCoder-LLM) (orca-agentinstruct-1M-v1, orca-math-word-problems-200k)
|
115 |
+
- [NousResearch](https://huggingface.co/NousResearch) (hermes-function-calling-v1)
|
116 |
+
- [AI-MO](https://huggingface.co/AI-MO) (NuminaMath-CoT, NuminaMath-TIR)
|
117 |
+
- [allenai](https://huggingface.co/allenai) (tulu-3-sft-mixture)
|
118 |
+
- [HuggingFaceTB](https://huggingface.co/HuggingFaceTB) (smoltalk)
|
119 |
+
- [m-a-p](https://huggingface.co/m-a-p) (CodeFeedback-Filtered-Instruction, Code-Feedback)
|
120 |
+
|
121 |
+
Special thanks to
|
122 |
+
- Meta, Qwen, and OpenCoder, who wrote papers and published models that were instrumental in creating Dolphin 3.0.
|
123 |
+
- [RLHFlow](https://huggingface.co/RLHFlow) for the excellent reward model used to filter the datasets
|
124 |
+
- Deepseek, for the ridiculously fast Deepseek-V3 that we used to augment the data.
|
125 |
+
|
126 |
+
|