Update README.md
Browse files
README.md
CHANGED
@@ -172,22 +172,22 @@ Assuming that you already have GGUF files downloaded. Here is how you can use th
|
|
172 |
```
|
173 |
wget https://github.com/Mozilla-Ocho/llamafile/releases/download/0.7.3/llamafile-0.7.3
|
174 |
```
|
175 |
-
2. **Run the model with
|
176 |
|
177 |
|
178 |
```markdown
|
179 |
-
|
180 |
```
|
181 |
|
182 |
|
183 |
```
|
184 |
-
./llamafile-0.7.3 -ngl 9999 -m
|
185 |
```
|
186 |
|
187 |
3. **Run with a chat interface:**
|
188 |
|
189 |
```
|
190 |
-
./llamafile-0.7.3 -ngl 9999 -m
|
191 |
```
|
192 |
|
193 |
Your browser should open automatically and display a chat interface. (If it doesn't, just open your browser and point it at http://localhost:8080)
|
|
|
172 |
```
|
173 |
wget https://github.com/Mozilla-Ocho/llamafile/releases/download/0.7.3/llamafile-0.7.3
|
174 |
```
|
175 |
+
2. **Run the model with prompt:**
|
176 |
|
177 |
|
178 |
```markdown
|
179 |
+
public class HelloWorld {\n public static void main(String[] args) {
|
180 |
```
|
181 |
|
182 |
|
183 |
```
|
184 |
+
./llamafile-0.7.3 -ngl 9999 -m NT-Java-1.1B_Q4_K_M.gguf --temp 0.6 -p "public class HelloWorld {\n public static void main(String[] args) {"
|
185 |
```
|
186 |
|
187 |
3. **Run with a chat interface:**
|
188 |
|
189 |
```
|
190 |
+
./llamafile-0.7.3 -ngl 9999 -m NT-Java-1.1B_Q4_K_M.gguf
|
191 |
```
|
192 |
|
193 |
Your browser should open automatically and display a chat interface. (If it doesn't, just open your browser and point it at http://localhost:8080)
|