5. The video search system according to claim 4 , wherein the video database stores a plurality of video bitstreams and meta-data of the video bitstreams, wherein each of the meta-data is established by performing a segmentation process on the corresponding video bitstream through a segmentation detecting procedure to generate a plurality of shots, indexing the shots by assigning a corresponding index tag to each of the shots according to a content of the shot, and establishing a semantic pattern of each of the shots according to a video feature of the shot, wherein the meta-data comprises the index tags and the semantic patterns corresponding to the shots.
4. A video search system, comprising: a search engine, with at least a processor which is configured for receiving meta-data of a query clip, wherein the meta-data comprises a first index tag and a first semantic pattern, and the first index tag is assigned by transforming features extracted from the query clip; and at least one video database, comprising a plurality of video clips, wherein the search engine retrieves one or more candidate clips from the video database according to the first index tag, converts the query clip and the candidate clips into a same format, compares the first semantic pattern with a semantic pattern of each of the candidate clips and adjacent video clips, and marks each of the candidate clips as a returnable video clip or a non-returnable video clip according to a comparison result, wherein the candidate clips marked as the returnable video clip are served as a query result matching the query clip.