1. A method for scene understanding based on a sequence of image frames, comprising: converting each pixel of each image frame to one or more corresponding neural spikes; extracting one or more features from said sequence of image frames by processing neural spikes corresponding to pixels of said sequence of image frames; encoding said one or more extracted features as one or more neural spikes; and classifying said one or more extracted features.