1. A computer-implemented method for identifying a portion of a video as a sports highlight, comprising: accessing a video; extracting, from the video, a feature set associated with frames of the video; identifying portions of the video, each portion associated with a portion of frames of the video and a portion of the feature set; detecting a set of events for each portion of the feature set using a set of event models; calculating an event vector for the set of events for each portion of the video; classifying each portion of the video using a plurality of highlight classifiers; and identifying each portion of the video as a highlight according to the classification result of the plurality of highlight classifiers.