Update README.md
Browse files
README.md
CHANGED
|
@@ -61,6 +61,8 @@ quantized_by: Second State Inc.
|
|
| 61 |
wasmedge --dir .:. --nn-preload default:GGML:AUTO:OpenHermes-2.5-Mistral-7B-Q5_K_M.gguf llama-api-server.wasm -p chatml -r '<|im_end|>'
|
| 62 |
```
|
| 63 |
|
|
|
|
|
|
|
| 64 |
- Run as LlamaEdge command app
|
| 65 |
|
| 66 |
```bash
|
|
|
|
| 61 |
wasmedge --dir .:. --nn-preload default:GGML:AUTO:OpenHermes-2.5-Mistral-7B-Q5_K_M.gguf llama-api-server.wasm -p chatml -r '<|im_end|>'
|
| 62 |
```
|
| 63 |
|
| 64 |
+
- Context size: `4096`
|
| 65 |
+
|
| 66 |
- Run as LlamaEdge command app
|
| 67 |
|
| 68 |
```bash
|