Spaces:

likewendy
/

phi-4

Running

likewendy commited on Jan 6

Commit

d2baa2c

1 Parent(s): 54f79ea

code

Files changed (1) hide show

app.py CHANGED Viewed

@@ -26,7 +26,7 @@ def respond(
         repo_id="matteogeniaccio/phi-4",
         filename="phi-4-Q4_K_M.gguf",
         verbose=True,
-        main_gpu=0,
         n_gpu_layers=-1
     )
     # 使用llama-cpp-python的方式生成响应

         repo_id="matteogeniaccio/phi-4",
         filename="phi-4-Q4_K_M.gguf",
         verbose=True,
+        main_gpu=1,
         n_gpu_layers=-1
     )
     # 使用llama-cpp-python的方式生成响应