1. A method for learning a structure of a video to detect events in the video consistent with the structure, comprising: selecting sets of features from the video; updating a hierarchical statistical model for each set of features; evaluating an information gain of the hierarchical statistical model; filtering redundant features; updating the hierarchical statistical model based on the filtered features; applying a Bayesian information criteria to each model and feature set pair; and rank ordering the model and feature set pairs to learn the structure and detect the events in the video in an unsupervised manner.