1. A method for processing data generated from a sequence of video frames, the method comprising: receiving, as a trajectory for a first object, a series of primitive events associated with a path of the first object depicted in the sequence of video frames as the first object moves through the scene, wherein each primitive event includes at least an object type and a set of one or more kinematic variables associated with the second object; after receiving the trajectory for the first object, receiving a first vector representation generated for the first object, wherein the first vector representation is generated from a primitive event symbol stream and a phase space symbol stream, and wherein the streams describe actions of at least the first object depicted in the sequence of video frames; exciting one or more nodes of a perceptual associative memory using the trajectory and the first vector representation; identifying, based on the one or more excited nodes, a percept; copying the percept to a workspace; in response to copying the percept to the workspace, selecting a codelet, wherein the codelet includes an executable sequence of instructions; and invoking execution of the codelet.