How to cluster label (in a multilabel classification problem) which mostly appear together in a class
The difficulty here is the design: if one just represents every &quot;class&quot; as an instance with a vector of its co-occurrences with other &quot;classes&quot;, then the clustering will only group the full group of instances/classes by how similar they are with other groups.
Instead I think that an instance should represent a pair of &quot;classes&quot;, using the PMI as a measure of how strongly they are associated.
An advanced option would be to represent each &quot;class&quot; as a node in a graph and add an edge between any two classes which occur together, weighted by their PMI value. Then use a graph-clustering algorithm to group the &quot;classes&quot;.