1. A method for classifying at least one object of interest in a video, the method comprising: accessing, using at least one processing device, a frame of the video, the frame including at least one object of interest to be classified; performing, using the at least one processing device, object detection on the frame to detect the object of interest; tracking, using the at least one processing device, the object of interest over a plurality of frames in the video over time using a persistent tracking capability; isolating, using the at least one processing device, a segment of the frame that includes the object of interest; classifying, using the at least one processing device, the object of interest by processing the segment using deep learning; and generating an output that indicates the classification of the object of interest.