Spaces:

chunking-ai
/

smoldocling-preview

Paused

taprosoft commited on 3 days ago

Commit

73d7517

verified ·

1 Parent(s): 1e92b0d

Update backends/smoldocling.py

Files changed (1) hide show

backends/smoldocling.py CHANGED Viewed

@@ -19,7 +19,7 @@ processor = AutoProcessor.from_pretrained("ds4sd/SmolDocling-256M-preview")
 model = AutoModelForVision2Seq.from_pretrained(
     "ds4sd/SmolDocling-256M-preview",
     torch_dtype=torch.bfloat16,
-    _attn_implementation="flash_attention_2",
 ).to(DEVICE)
 # Create input messages

 model = AutoModelForVision2Seq.from_pretrained(
     "ds4sd/SmolDocling-256M-preview",
     torch_dtype=torch.bfloat16,
+    _attn_implementation="eager",
 ).to(DEVICE)
 # Create input messages