1. A method for semantically labeling an image acquired of a scene, comprising steps of: obtaining a local semantic feature from each local region in the image; combining recursively the local semantic features to form intermediate segments until a semantic feature for the entire image is obtained; decombining recursively the semantic feature for the entire image into intermediate segments until an enhanced semantic feature for each local region is obtained; and labeling each local region according to the enhanced semantic feature, wherein the steps are performed in a processor.