Spaces:
Running
Running
File size: 2,010 Bytes
1d777c4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 |
If model uses custom prompt template - you needed to add this chat template to config file
There is some examples:
Will be added to readme later...
empty template
```json
"context_prompt_begin": "",
"context_prompt_end": "",
"user_prompt_begin": "",
"user_prompt_end": "",
"bot_prompt_begin": "",
"bot_prompt_end": "",
```
ChatML
```
<|im_start|>system
{context}
<|im_end|>
<|im_start|>
{prompt}
<|im_end|>
<|im_start|>
{answer}
<|im_end|>
```
```json
"context_prompt_begin": "<|im_start|>system\n",
"context_prompt_end": "<|im_end|>",
"user_prompt_begin": "<|im_start|>\n",
"user_prompt_end": "<|im_end|>",
"bot_prompt_begin": "<|im_start|>\n",
"bot_prompt_end": "<|im_end|>",
```
Llama 2
```
[INST] <<SYS>>
{context}
<</SYS>>
[/INST]
[INST]
{prompt}
[/INST]
{answer}
```
```json
"context_prompt_begin": "[INST] <<SYS>>\n",
"context_prompt_end": "<</SYS>>",
"user_prompt_begin": "[INST]\n",
"user_prompt_end": "[/INST]",
"bot_prompt_begin": "",
"bot_prompt_end": "",
```
LimaRP-Alpaca
```
### Instruction:
Play the role of Character. You must engage in a roleplaying chat with User below this line. Do not write dialogues and narration for User. Character should respond with messages of medium length.
{context}
### Input:
{prompt}
### Response:
{answer}
```
```json
"context_prompt_begin": "### Instruction:\nPlay the role of Character. You must engage in a roleplaying chat with User below this line. Do not write dialogues and narration for User. Character should respond with messages of medium length.\n",
"context_prompt_end": "",
"user_prompt_begin": "### Input:\n",
"user_prompt_end": "\n",
"bot_prompt_begin": "### Response:\n",
"bot_prompt_end": "\n",
```
Zephyr
```
<|system|>
{context}
</s>
<|user|>
{prompt}</s>
<|assistant|>
{answer}
</s>
```
```json
"context_prompt_begin": "<|system|>\n",
"context_prompt_end": "</s>",
"user_prompt_begin": "<|user|>\n",
"user_prompt_end": "</s>",
"bot_prompt_begin": "<|assistant|>\n",
"bot_prompt_end": "</s>",
```
|