1. A method of recognizing a goal of an actor in an environment, the method comprising: providing a plan library including a listing of possible goals and plans to accomplish each of the possible goals; observing actions relative to the actor; considering whether hypothesized unobserved actions have occurred; and identifying one or more plans consistent with the observed actions and the consideration of hypothesized unobserved actions.