Chroma-Extra

Running on Zero

gokaygokay commited on Feb 5

Commit

5e83df6

1 Parent(s): a6b28a4

understanding

Files changed (1) hide show

vlm_captions.py CHANGED Viewed

@@ -11,7 +11,8 @@ class VLMCaptioning:
             'openbmb/MiniCPM-o-2_6',
             trust_remote_code=True,
             attn_implementation='sdpa',
-            torch_dtype=torch.bfloat16
         )
         self.model = self.model.eval().cuda()
         self.tokenizer = AutoTokenizer.from_pretrained('openbmb/MiniCPM-o-2_6', trust_remote_code=True)

             'openbmb/MiniCPM-o-2_6',
             trust_remote_code=True,
             attn_implementation='sdpa',
+            torch_dtype=torch.bfloat16,
+            init_vision=True,
         )
         self.model = self.model.eval().cuda()
         self.tokenizer = AutoTokenizer.from_pretrained('openbmb/MiniCPM-o-2_6', trust_remote_code=True)