<div class="description">
<p>Given the problem of detecting objects in video, existing neural-network solutions rely on a post-processing step to combine information across frames and strengthen conclusions. This technique has been successful for videos with simple, dominant objects but it cannot detect objects if a single frame does not contain enough information to distinguish the object from its background. This problem is especially relevant in the maritime environment, where a whitecap and a human survivor may look identical except for their movement through the scene. In order to evaluate a neural network's ability to combine information across multiple frames of information, we developed two versions of a convolutional neural network: one version was given multiple frames as input while the other version was only provided a single frame. We measured the performance of both versions on the benchmark 3DPeS Dataset and observed a significant increase in both recall and precision when the network was given 10 frames instead of just one.We also developed our own noisy dataset consisting of small birds flying across the Monterey Bay. This dataset contained many instances where, in a single frame, the objects to be detected were indistinguishable from the surrounding waves and debris. For this dataset, multiple frames were essential for reliable detections. We also observed a greater improvement in the false negative rate compared to the false positive rate in this noisier dataset, suggesting that the additional frames were especially useful for improving the detection of hard-to-detect objects.
</p>
<br>Subjects: Convolutional neural networks; machine learning; object detection; computer vision</div>
<div class="fn value">
Downs, Justin</div>
Internet Archive identifier