pigas
/

TinyLlama-1.1B-Chat-v0.3-GPTQ-8bits

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

TinyLlama-1.1B-Chat-v0.3-GPTQ-8bits / generation_config.json

pigas's picture

Upload LlamaForCausalLM

4474cb1 verified about 1 year ago

history blame contribute delete

63 Bytes

	{
	"max_new_tokens": 32,
	"transformers_version": "4.39.1"
	}