1. A control apparatus for controlling one or more image capturing apparatuses, the control apparatus comprising: an entry time determination unit configured to determine a time at which an imaging object enters an imageable area of an image capturing apparatus; and a tracking object determination unit configured to determine, if the number of tracking objects already tracked is less than a tracking object upper limit and the time at which the imaging object enters the imageable area of the image capturing apparatus is not within a predetermined time period, that the imaging object entering the imageable area is to be tracked by the image capturing apparatus in addition to the tracking objects already tracked, and if the time at which the imaging object enters the imageable area of the image capturing apparatus is within the predetermined time period, that the imaging object entering the imageable area is not to be tracked by the image capturing apparatus, wherein at least one of the entry time determination unit or the tracking object determination unit is implemented by a processor and a memory.