p1atdev
/

CogView4-6B-quanto_int8

Model card Files Files and versions Community

p1atdev commited on 16 days ago

Commit

b08d660

·

verified ·

1 Parent(s): f1bc8f0

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -27,7 +27,7 @@ tags:
 |`torch.bfloat16` | Quanto Int8 |
 | - | - |
 | <img src="./images/sample_bf16_01.jpg" width="320px" /> | <img src="./images/sample_quanto_01.jpg" width="320px" /> |
-| VRAM 40GB | VRAM 28GB |
 <details><summary>Generation parameters</summary>

 |`torch.bfloat16` | Quanto Int8 |
 | - | - |
 | <img src="./images/sample_bf16_01.jpg" width="320px" /> | <img src="./images/sample_quanto_01.jpg" width="320px" /> |
+| VRAM 40GB (without offloading) | VRAM 28GB (without offloading) |
 <details><summary>Generation parameters</summary>