Hugging Face's logo

kosbu
/
Llama-3.3-70B-Instruct-AWQ

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
awq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
Model card Files Community
kosbu commited on
Commit
ee59475
·
verified ·
1 Parent(s): 3cb683e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -20,3 +20,6 @@ tags:
20
  pipeline_tag: text-generation
21
  library_name: transformers
22
  ---
 
 
 
 
20
  pipeline_tag: text-generation
21
  library_name: transformers
22
  ---
23
+ # Llama-3.3-70B-Instruct AWQ 4-Bit Quantized Version
24
+
25
+ This repository provides the AWQ 4-bit quantized version of [`meta-llama/Llama-3.3-70B-Instruct`](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct), originally developed by Meta AI.