Raj-Maharajwala
/

Open-Insurance-LLM-Llama3-8B-GGUF

Model card Files Files and versions Community

Raj-Maharajwala commited on Nov 26, 2024

Commit

31cebe0

·

verified ·

1 Parent(s): 962c488

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -47,7 +47,7 @@ Fine-tuned for insurance-related queries and conversations.
 - **Finetuned Model:** Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B
 - **Quantized Model:** Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B-GGUF
 - **Model Architecture:** Llama
-- **Quantization:** 8-bit (Q8_0)
 - **Developer:** Raj Maharajwala
 - **License:** llama3
 - **Language:** English

 - **Finetuned Model:** Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B
 - **Quantized Model:** Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B-GGUF
 - **Model Architecture:** Llama
+- **Quantization:** 8-bit (Q8_0), 5-bit (Q5_K_M), 4-bit (Q4_K_M), 16-bit
 - **Developer:** Raj Maharajwala
 - **License:** llama3
 - **Language:** English