Spaces:

muryshev
/

llama-cpp-server-7b

Runtime error

muryshev commited on Dec 25, 2023

Commit

5dea8c2

1 Parent(s): 0e50621

Set up threads number

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -25,4 +25,4 @@ ENV LC_ALL=C.utf8
 EXPOSE 7860
-CMD ./server -m /data/model.gguf -c 2048 --port 7860 --host 0.0.0.0


25
26	EXPOSE 7860
27
28	+ CMD ./server -m /data/model.gguf -c 4096 -t 2 --port 7860 --host 0.0.0.0