1. A method of generating a bilinear spatiotemporal basis model, comprising: providing a trajectory basis for the bilinear spatiotemporal basis model; receiving three-dimensional spatiotemporal data for a training sequence; estimating a shape basis for the bilinear spatiotemporal basis model using the three-dimensional spatiotemporal data; and computing coefficients common to the trajectory basis and the shape basis for the bilinear spatiotemporal basis model using the trajectory basis and the shape basis, wherein each of the coefficients represents a weight of an outer product of a respective trajectory basis vector and a respective shape basis vector.