Learning with Multi-Group Guarantees for Clusterable Subpopulations
multicalibration;fairness;clustering
margin violation
Submission Desk Rejected by Program Chairs
@misc{
dai2024learning,
title={Learning with Multi-Group Guarantees for Clusterable Subpopulations},
author={Jessica Dai and Nika Haghtalab and Eric Zhao},
year={2024},
url={https://openreview.net/forum?id=tEM1u9VT2W}
}
A canonical desideratum for prediction problems is that performance guarantees should hold not just on average over the population, but also for meaningful subpopulations within the overall population. 
But what constitutes a meaningful subpopulation?
In this work, we take the perspective that relevant subpopulations should be defined with respect to the clusters that naturally emerge from the distribution of individuals for which predictions are being made. 
In this perspective, a population refers to a mixture model whose components constitute the relevant subpopulations.
We suggest two formalisms for capturing per-subgroup guarantees: first, by attributing each individual to the component from which they were most likely drawn, given their features; and second, by attributing each individual to all components in proportion to their relative likelihood of having been drawn from each component.
Using online calibration for Gaussian mixture models as a case study, we study a multi-objective algorithm that provides guarantees for each of these formalisms by handling all plausible underlying subpopulation structures simultaneously, and achieve a $O(T^{1/2})$ rate even when the subpopulations are not well-separated.
In comparison, the more natural _cluster-then-predict_ approach that first recovers the structure of the subpopulations and then makes predictions suffers from a $O(T^{2/3})$ rate and requires the subpopulations to be separable.
Along the way, we prove that providing per-subgroup calibration guarantees for underlying clusters can be easier than learning the clusters: separation between median subgroup features is required for the latter but not the former.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
~Jessica_Dai1 ~Nika_Haghtalab2 ~Eric_Zhao1
Jessica Dai Nika Haghtalab Eric Zhao
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
multicalibration fairness clustering
I certify that there is no acknowledgement section in this submission for double blind review.
dai|learning_with_multigroup_guarantees_for_clusterable_subpopulations
/pdf/b56703b44d56aec385647d3158ff38e7dd4bd958.pdf
learning theory
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Learning with Multi-Group Guarantees for Clusterable Subpopulations
ICLR 2025 Conference Desk Rejected Submission
ICLR.cc/2025/Conference/Desk_Rejected_Submission