1. An apparatus of generating a visual attention map, the apparatus comprising: a downscaling unit to downscale a two-dimensional (2D) image and to generate at least one downscaled image; a feature map generation unit to extract feature information from the 2D image and the at least one downscaled image, and to generate at least one feature map; and an attention computation unit to perform low-level attention computation using the at least one feature map, and to generate the visual attention map based on a result of the low-level attention computation.