Spaces:

allekssandr
/

Kek-bot

Sleeping

Aleksandr Maiorov commited on Feb 18

Commit

11122fa

1 Parent(s): 2b0aafa

v0.6.2 - просто апи для генерации текста

Files changed (1) hide show

app.py CHANGED Viewed

@@ -43,7 +43,7 @@ try:
         repo_id=REPO_ID,
         filename='Vikhr-Qwen-2.5-1.5b-Instruct-Q8_0.gguf',
         n_threads=2,
-        n_batch=4096,
         n_gpu_layers=-1,
         n_ctx=4096,
         temperature=0.3,

         repo_id=REPO_ID,
         filename='Vikhr-Qwen-2.5-1.5b-Instruct-Q8_0.gguf',
         n_threads=2,
+        n_batch=512,
         n_gpu_layers=-1,
         n_ctx=4096,
         temperature=0.3,