1. A method for performing hierarchical super-resolution of an input image, comprising: dividing the input image into patches; performing spatial decomposition of the input image to at least two lower decomposition levels, wherein at least two lower decomposition level images are obtained; and for each current patch of the input image, searching in the lower decomposition level images one or more similar patches of same size as the current patch; for each of the similar patches found in the searching, determining its respective parent patch in the next higher decomposition level, wherein the parent patches are larger than the current patch; obtaining weighted determined parent patches using a weight determined from a sparsity of the patch, wherein the sparsity corresponds to a number of non-zero DCT coefficients in the patch; accumulating the weighted determined parent patches to obtain an upsampled high-resolution patch; and replacing an upsampled patch of an upsampled frame corresponding to the current patch with the upsampled high-resolution patch.