IPEC-COMMUNITY
/

spatialvla-4b-224-pt

Image-Text-to-Text

feature-extraction

Foundation Vision-language-action Model

Generalist Robot Policy

Model card Files Files and versions Community

delinqu commited on Feb 27

Commit

170bdc5

·

verified ·

1 Parent(s): 2eae0b7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -52,7 +52,7 @@ processor = AutoProcessor.from_pretrained(model_name_or_path, trust_remote_code=
 model = AutoModel.from_pretrained(model_name_or_path, trust_remote_code=True, torch_dtype=torch.bfloat16).eval().cuda()
 image = Image.open("example.png").convert("RGB")
-prompt = "What action should the robot take to pick the cpu?"
 inputs = processor(images=[image], text=prompt, return_tensors="pt")
 generation_outputs = model.predict_action(inputs)

 model = AutoModel.from_pretrained(model_name_or_path, trust_remote_code=True, torch_dtype=torch.bfloat16).eval().cuda()
 image = Image.open("example.png").convert("RGB")
+prompt = "What action should the robot take to pick the cup?"
 inputs = processor(images=[image], text=prompt, return_tensors="pt")
 generation_outputs = model.predict_action(inputs)