Getting kinds on features that has high confidence on classfication
Yes you can use a decision tree for example. These trees can have a stop criterion. For example if the leaf is too small in sample size or, and this is interesting for you, is above a pre-defined purity threshold. By discarding all the final leafs that were created due to not purity related conditions you should end up with a set of rules like you described.