Pham
commited on
chore: Add CLI commands
Browse files
README.md
CHANGED
@@ -8,12 +8,14 @@ Meta developed and released the Meta Llama 3 family of large language models (LL
|
|
8 |
|
9 |
## Variants
|
10 |
|
11 |
-
|
12 |
-
|
13 |
-
|
|
14 |
-
|
|
15 |
-
|
|
16 |
-
|
|
|
|
|
|
17 |
|
18 |
## Use it with Jan (UI)
|
19 |
|
|
|
8 |
|
9 |
## Variants
|
10 |
|
11 |
+
## Variants
|
12 |
+
|
13 |
+
| No | Variant | Cortex CLI command |
|
14 |
+
| --- | --- | --- |
|
15 |
+
| 1 | [8B-onnx](https://huggingface.co/cortexhub/llama3/tree/8B-onnx) | `cortex run llama3:8B-onnx` |
|
16 |
+
| 2 | [8B-tensorrtllm-linux-ada](https://huggingface.co/cortexhub/llama3/tree/8B-tensorrtllm-linux-ada) | `cortex run llama3:8B-tensorrtllm-linux-ada` |
|
17 |
+
| 3 | [8B-tensorrtllm-windows-ada](https://huggingface.co/cortexhub/llama3/tree/8B-tensorrtllm-windows-ada) | `cortex run llama3:8B-tensorrtllm-windows-ada` |
|
18 |
+
| 4 | [8B-gguf](https://huggingface.co/cortexhub/llama3/tree/8B-gguf) | `cortex run llama3:8B-gguf` |
|
19 |
|
20 |
## Use it with Jan (UI)
|
21 |
|