1. A method for temporal upscaling of video data, comprising: repeatedly spatially downsampling input video data, thereby obtaining spatially downsampled video data at a coarsest spatial resolution scale; temporally upscaling the spatially downsampled video data at the coarsest spatial resolution scale to generate an estimate of temporally upscaled video data at the coarsest spatial resolution scale; spatially upscaling the estimate of temporally upscaled video data at the coarsest spatial resolution scale to generate an estimate of temporally upscaled video data at an intermediate spatial resolution; and spatially upscaling the estimate of temporally upscaled video data at the intermediate spatial resolution to generate an estimate of temporally upscaled video data at the original spatial resolution.