1. A computer-implemented method for action recognition in a sports video, the method comprising: receiving a plurality of training videos, each of the training videos associated with a sports type, and each of the training videos including a plurality of video frames; training, for each sports type of a plurality of different sports types, one or more feature models using the plurality of the training videos, the training comprising: training a player detector for detecting location of a player in each video frame of a training video; training a set of key pose identifiers for a sports action distinctively associated with each sports type of the sports videos, the sports action associated with each sports type of the sports videos being represented by a set of distinctive poses; and training a meta classifier for determining a likelihood that the sports action has happened in a training video based on identification result by the trained set of key pose identifiers; selecting one or more trained feature models that are associated with a sports type of an input video; and applying the selected trained feature models to a plurality of video frames of the input video to recognize a sports action captured by the input video.