13. A system, comprising: a video input source; a processor; and a memory storing a machine learning engine, wherein the machine learning engine is configured to perform an operation for processing video image data, the operation comprising: detecting a plurality of objects in the video image data; and for each object: generating a primitive event symbol stream identifying one or more primitive events engaged in by the object, wherein each primitive event represents a behavior engaged in by the object, generating a phase-space symbol stream representing quantitative characteristics of the object, wherein the phase-space symbol stream for the object indicates a trajectory of that object in the video image data over time, and combining the primitive event symbol stream and the phase-space symbol stream to generate a vector representation of the behavior engaged in by the object as depicted in the video image data.
17. The system of claim 13 , wherein identifying the primitive events comprises: analyzing kinematic data and posture data associated with one of the objects; and generating the primitive event symbol stream based on the analyzed data.