1. A method for an intelligent video processing system based on object detection, comprising: receiving an input video sequence corresponding to a video program; obtaining a plurality of frames of the input video sequence; obtaining a computational constraint and a temporal rate constraint; determining one or more regions of interest (ROIs) of the plurality of frames of the input video sequence based on the computational constraint and temporal rate constraint; selecting a desired set of frames from the plurality of frames based on the ROIs such that the desired set of frames substantially represent a view path of the plurality of frames; and detecting object occurrences from the desired set of frames based on the selected desired set of frames such that a computational cost and a number of frames for detecting the object occurrences are under the computational constraint and temporal rate constraint; wherein: the computational constraint specifies an upper bound on a total processing time consumed by determining the one or more ROIs, selecting the desired set of frames and detecting the object occurrences; and the computational constraint and the temporal rate constraint are automatically determined according to operational parameters and computational capacity of the intelligent video processing system.