Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
noxneural
/
Hermes-3-Llama-3.2-3B-awq-4-bit
like
0
Text Generation
Transformers
Safetensors
English
llama
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
quantization
AWQ
conversational
text-generation-inference
4-bit precision
awq
arxiv:
2408.11857
License:
llama3
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
6582644
Hermes-3-Llama-3.2-3B-awq-4-bit
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
noxneural
Pushing quantized 4-bit model
6582644
verified
6 months ago
.gitattributes
Safe
1.57 kB
Pushing quantized 4-bit model
6 months ago
config.json
1.17 kB
Pushing quantized 4-bit model
6 months ago
generation_config.json
Safe
214 Bytes
Pushing quantized 4-bit model
6 months ago
model.safetensors
2.25 GB
LFS
Pushing quantized 4-bit model
6 months ago
special_tokens_map.json
Safe
444 Bytes
Pushing quantized 4-bit model
6 months ago
tokenizer.json
Safe
17.2 MB
LFS
Pushing quantized 4-bit model
6 months ago
tokenizer_config.json
50.4 kB
Pushing quantized 4-bit model
6 months ago