Spaces:
Running
Running
dora
commited on
fix MODELS env (#663)
Browse files
README.md
CHANGED
|
@@ -288,7 +288,7 @@ If you want to run chat-ui with llama.cpp, you can do the following, using Zephy
|
|
| 288 |
3. Add the following to your `.env.local`:
|
| 289 |
|
| 290 |
```env
|
| 291 |
-
MODELS
|
| 292 |
{
|
| 293 |
"name": "Local Zephyr",
|
| 294 |
"chatPromptTemplate": "<|system|>\n{{preprompt}}</s>\n{{#each messages}}{{#ifUser}}<|user|>\n{{content}}</s>\n<|assistant|>\n{{/ifUser}}{{#ifAssistant}}{{content}}</s>\n{{/ifAssistant}}{{/each}}",
|
|
@@ -308,7 +308,7 @@ MODELS=[
|
|
| 308 |
}
|
| 309 |
]
|
| 310 |
}
|
| 311 |
-
]
|
| 312 |
```
|
| 313 |
|
| 314 |
Start chat-ui with `npm run dev` and you should be able to chat with Zephyr locally.
|
|
@@ -324,7 +324,7 @@ ollama run mistral
|
|
| 324 |
Then specify the endpoints like so:
|
| 325 |
|
| 326 |
```env
|
| 327 |
-
MODELS
|
| 328 |
{
|
| 329 |
"name": "Ollama Mistral",
|
| 330 |
"chatPromptTemplate": "<s>{{#each messages}}{{#ifUser}}[INST] {{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}} {{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s> {{/ifAssistant}}{{/each}}",
|
|
@@ -345,7 +345,7 @@ MODELS=[
|
|
| 345 |
}
|
| 346 |
]
|
| 347 |
}
|
| 348 |
-
]
|
| 349 |
```
|
| 350 |
|
| 351 |
#### Amazon
|
|
|
|
| 288 |
3. Add the following to your `.env.local`:
|
| 289 |
|
| 290 |
```env
|
| 291 |
+
MODELS=`[
|
| 292 |
{
|
| 293 |
"name": "Local Zephyr",
|
| 294 |
"chatPromptTemplate": "<|system|>\n{{preprompt}}</s>\n{{#each messages}}{{#ifUser}}<|user|>\n{{content}}</s>\n<|assistant|>\n{{/ifUser}}{{#ifAssistant}}{{content}}</s>\n{{/ifAssistant}}{{/each}}",
|
|
|
|
| 308 |
}
|
| 309 |
]
|
| 310 |
}
|
| 311 |
+
]`
|
| 312 |
```
|
| 313 |
|
| 314 |
Start chat-ui with `npm run dev` and you should be able to chat with Zephyr locally.
|
|
|
|
| 324 |
Then specify the endpoints like so:
|
| 325 |
|
| 326 |
```env
|
| 327 |
+
MODELS=`[
|
| 328 |
{
|
| 329 |
"name": "Ollama Mistral",
|
| 330 |
"chatPromptTemplate": "<s>{{#each messages}}{{#ifUser}}[INST] {{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}} {{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s> {{/ifAssistant}}{{/each}}",
|
|
|
|
| 345 |
}
|
| 346 |
]
|
| 347 |
}
|
| 348 |
+
]`
|
| 349 |
```
|
| 350 |
|
| 351 |
#### Amazon
|