1. An apparatus for processing multi-energy image data to separate at least two types of material, comprising a classification unit, wherein the classification unit is configured to obtain a classification of pixels or voxels belonging to the types of material based on a threshold which is adaptively changed in dependence on multi-energy intensity information associated with the pixels or voxels.