Spaces:

Luigi
/

ZeroGPU-LLM-Inference

Running on Zero

App Files Files Community

ZeroGPU-LLM-Inference / app.py

Commit History

improve storage management

37ee1f3

Luigi commited on Apr 10

provide more models, secure memory usage

cd26609

Luigi commited on Apr 10

increase context length to 2048

56919fd

Luigi commited on Apr 10

switch to 7b model

ea7adad

Luigi commited on Apr 10

switch to 3b q2 model

88b1f39

Luigi commited on Apr 9

adjust thread numbers

4443d46

Luigi commited on Apr 9

switch to 1.5b

4d633ef

Luigi commited on Apr 9

fix model id

8287454

Luigi commited on Apr 9

Add app.py & requirements.txt

0ff6c39

Luigi commited on Apr 9