1. A method for feature selection based on hierarchical local-region analysis of feature characteristics in a data set, comprising: partitioning a data space associated with a data set into a hierarchy of pluralities of local regions; using a similarity metric to evaluate for each local region a relationship measure between input features and a selected output feature; and identifying one or more relevant features, by using the relationship measure for each local region.