1. A digital video camera system comprising: an image sensor configured to capture a digital image; an optical system configured to form an image of a scene onto the image sensor; a storage memory configured to store captured video sequences; and a processing system configured to: capture a video sequence of the scene from the image sensor, the video sequence including a time sequence of image frames; specify reference data separate from a reference in the captured video sequence, wherein the reference data indicates a feature of interest, and wherein the reference data includes information specifying a desired characteristic of the image frames; analyze image frames using a feature recognition algorithm to identify a subset of the image frames that contain the feature of interest and have the desired characteristic; form a video summary including fewer than all of the image frames in the captured video sequence, wherein the video summary includes at least part of the identified subset of image frames containing the feature of interest and having the desired characteristic; and store a representation of the video summary in the storage memory.