1. A method for modeling objects within two-dimensional video data by three-dimensional models as a function of object type and motion, the method comprising: in response to observing an image of an object in motion in a two-dimensional image field of view of a video data input from a camera, determining an initial three-dimensional location of the observed two-dimensional object image as an intersection between a ground plane of the camera field of view and a backward projected line passing through a center of the camera and a point on the object two-dimensional image within a focal plane in the two-dimensional image field of view of the video data input at an initial time; determining a second three-dimensional location of the observed two-dimensional object image via the processor as an intersection between the ground plane and another backward projected line passing through the center of the camera and the point on the object two-dimensional image within the video data input two-dimensional image field of view focal plane at a second time that is subsequent to the initial time; determining a heading direction of the object as a function of a movement of the two-dimensional object image from the determined initial three-dimensional location to the determined second subsequent three-dimensional location; replacing the two-dimensional object image within the video data input with a selected three-dimensional polygonal model; orienting the selected three-dimensional polygonal model replacing the two-dimensional object image within the video data input in the determined heading direction; and scaling a bounding box of the selected three-dimensional polygonal model replacing the two-dimensional object image within the video data input from the camera to fit an image blob bounding box determined for the observed two-dimensional object image.