1. A method of processing a sports video, comprising the steps of: analyzing the sports video to detect at least one semantic event, each of which is associated with a segment length; assigning a segment length to the at least one semantic event according to importance of a corresponding event; extracting a scene segment associated with the at least one semantic event out of the sports video according to the segment length; and generating a summarized video according to the detected at least one semantic event; wherein the segment length of each semantic event varies according to importance and weight of each semantic event and varies according to a context analysis result showing the relative importance of each semantic event comparing to its prior and subsequent events throughout the sports video; and the step of extracting the scene segment associated with the at least one semantic event out of the sports video according to the segment length comprises: generating the semantic event according to at least one of base bag, score, and out in a score board region.