Hugging Face's logo

Spaces:
KetanJogadankar
/
DataAnnotator_LLM_RAG
Runtime error

App Files Community
KetanJogadankar commited on
Commit
1717846
·
verified ·
1 Parent(s): 1d0ee5f

removed gpu layers

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -40,7 +40,7 @@ llm = CTransformers(
40
  "repetition_penalty": repetition_penalty,
41
  "last_n_tokens": 4,
42
  "stream": True,
43
- "gpu_layers": 1000
44
  }
45
  )
46
 
 
40
  "repetition_penalty": repetition_penalty,
41
  "last_n_tokens": 4,
42
  "stream": True,
43
+ "gpu_layers": 0
44
  }
45
  )
46