RedHatAI
/

granite-3.1-8b-base-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions Community

ekurtic commited on 7 days ago

Commit

942e9fe

·

verified ·

1 Parent(s): 1edece5

Update README.md (#1)

- Update README.md (83542301a2f705750a8e3b0d9fa5e199918f81e5)

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ library_name: transformers
   - **Output:** Text
 - **Model Optimizations:**
   - **Weight quantization:** INT4
-  - **Activation quantization:** INT4
 - **Release Date:** 1/8/2025
 - **Version:** 1.0
 - **Model Developers:** Neural Magic

   - **Output:** Text
 - **Model Optimizations:**
   - **Weight quantization:** INT4
+  - **Activation quantization:** BF16
 - **Release Date:** 1/8/2025
 - **Version:** 1.0
 - **Model Developers:** Neural Magic