Hugging Face's logo

Spaces:
lukestanley
/
ChillTranslator
Sleeping

App Files Community
1
ChillTranslator / utils.py

Commit History

Update default GPU layer, temperature values
e327a9e

lukestanley commited on

Add env vars to set GPU layer count and context size, make verbose
e01e28e

lukestanley commited on

Add n_gpu_layers parameter to Llama initialization
88e6118

lukestanley commited on

Fix: Move n_ctx parameter to model setup!
358cd20

lukestanley commited on

Fix check for LLM_MODEL_PATH to avoid load error
ff938c3

lukestanley commited on

Auto-downloads model if env var is not set
74d6e52

Luke Stanley commited on

Make llm_stream_sans_network actually stream to stdout
a0f49a0

Luke Stanley commited on

Default to in-memory LLM interface
ddb0d91

Luke Stanley commited on

Add comment about adaptability
6c32632

lukestanley commited on

Print new line after LLM output end and some linting
3ebb6e1

lukestanley commited on

Makes URL more obvious, update comments, lowers temp
a96b492

lukestanley commited on

Move prompt strings and types to own file, reorder code a bit
139217d

lukestanley commited on

Linting with Black
e4b918c

lukestanley commited on

Removes unused code
811e485

lukestanley commited on

Removed unused lines
f84c1a6

lukestanley commited on

Slight refactor tidying
327982a

lukestanley commited on