1. A system for polyp detection using optical images acquired during a colonoscopy, the system comprising: an input configured to receive a set of optical images acquired from a patient during a colonoscopy; a processor configured to process the series of optical images with steps comprising: i. receiving the set of optical images from the input; ii. generating polyp candidates by analyzing the received set of optical images; iii. generating a plurality of image patches around locations associated with the generated polyp candidates; iv. applying a set of convolutional neural networks to the corresponding image patches; v. computing probabilities indicative of a maximum response for each convolutional neural network; vi. identifying polyps using the computed probabilities, wherein the processor is further configured to compute a confidence score for each polyp candidate using the computed probabilities; vii. generating a report indicating identified polyps; and an output for displaying the report.