Spatial Reasoning from Natural Language Instructions for Robot Manipulation
Sagar Gubbi Venkatesh Anirban Biswas Raviteja Upadrashta Vikram Srinivasan Partha Talukdar Bharadwaj Amrutur Sagar Gubbi Venkatesh Anirban Biswas Raviteja Upadrashta Vikram Srinivasan Partha Talukdar Bharadwaj Amrutur
Robots that can manipulate objects in unstructured environments and collaborate with humans can benefit immensely by understanding natural language. We propose a pipelined architecture of two stages to perform spatial reasoning on the text input. All the objects in the scene are first localized, and then the instruction for the robot in natural language and the localized co-ordinates are mapped to...