Statistical Significance of Clustering for High-Dimensional Count Data
Unsupervised learning;Cluster index;Generalized PCA;Dimension reduction;High-dimension low-sample size data
I have read and agree with the venue's withdrawal policy on behalf of myself and my co-authors.
Yes
No ethics review needed.
1. In the "1 INTRODUCTION" section, in the sentence "However, the significance of clustering for count data has not been thoroughly established," there seems to be a missing period before "However."
2. In the '2.1 CLUSTER SIGNIFICANCE FOR MIXTURE OF GAUSSIAN DISTRIBUTIONS' section, the formulas for CI and p-value are not numbered. Please ensure the numbering of formulas throughout the text is consistent.
3. Although this paper compares SigClust-DEV with existing SigClust variants, comparing it with other methods for assessing clustering significance for count data would provide a more comprehensive evaluation of the proposed method.
4. In section 2.3, SigClust-DEV first maps the data into a moderate-dimensional latent feature space Z using PCA, and then maps it further into another low-dimensional space Y using MDS. After two mappings, the data is no longer in a high-dimensional space, which may contradict the theme of the article? Additionally, in the subsequent implementation process, it would be helpful to supplement detailed parameter information for these two mappings.
5. In section 4.2 'LEARNING LATENT MEDICAL GROUP STRUCTURE USING HER', hierarchical clustering is chosen for exploration. Why not consider using other clustering methods?
The task of assessing the statistical significance of clustering in high-dimensional count data is of interest especially in the bioinformatic domain.
Writing and presentation skill is well.
The paper presents a novel approach, SigClust-DEV, aimed at assessing the statistical significance of clustering in high-dimensional count data, with a focus on applications in biomedical research. The authors identify key limitations in existing clustering methods, specifically highlighting the inadequacy of traditional SigClust in handling discrete, non-Gaussian high-dimensional data such as genomic count data. By proposing a deviance-based extension of SigClust, the paper addresses these challenges and demonstrates the proposed method’s superiority through extensive simulations. Additionally, the application to real-world datasets, including scRNA sequencing and EHRs of cancer patients, adds practical relevance and robustness to the findings. Overall, this paper is well-organized and well-written.
SigClust-DEV first maps the data into a moderate-dimensional latent feature space Z using PCA, and then maps it further into another low-dimensional space Y using MDS. After two mappings, the data is no longer in a high-dimensional space, which may contradict the theme of the article?
The performance of this method and its practical application value should be evaluated on more diverse types of data.
Yes
No ethics review needed.
How does the performance of other methods compare to the proposed method in EHR?
What impact do the parameters have on the robustness of the algorithm? 
How does your method perform facing a mixture of Gaussian distributions (and, more generally, continuous data) compared to others? Is it specialized in count data?
The motivation and idea of methodology are well presented.
This work combined the idea of generalized PCA (2002) that maximizes the likelihood of exponential family with a recent idea of MDS-based SigClust (2024).
Such a combination added flexibility in dealing with data types from exponential families than the past methods and is "more suitable" for the count data.
1. Method and algorithm: 
The main text needs more justification (results and discussion) to explain the choice of parameters ( i.e., the selected dimensions for PCA and MDS) and how they influence the algorithm's robustness. Consider providing sensitivity analyses showing how results change with different PCA/MDS dimensions.

2. Method and algorithm:  
Computational complexity against past methods should be discussed (for scalability and feasibility in large datasets, especially in the modern data era). Consider providing run-time comparison against existing methods on datasets of varying sizes, or analyze the asymptotic complexity of SigClust-DEV compared to previous approaches.

3. Simulation:  
Evaluation in noisy simulation settings should be added. Biological data, particularly scRNA-seq, and EHRs, often contain noise due to technical artifacts or measurement errors. It’s worth assessing how SigClust-DEV performs under varying noise levels and its robustness against noise. Some noises to consider may be dropout noises and Gaussian noises.

3. Real data: 
More results on the EHR dataset regarding the performance of existing algorithms should also be added.
Yes
No ethics review needed.
How does SigClust-DEV compare to other contemporary methods for testing clustering significance in count data (e.g., methods based on bootstrapping or permutation testing)?
SigClust-DEV extends traditional SigClust methodology to handle high-dimensional count data, which is challenging due to over-dispersion and zero inflation in datasets like scRNA.
This paper proposes SigClust-DEV, a novel method for evaluating the statistical significance of clustering high-dimensional count data. It is tailored for applications in biomedical research where such data is prevalent. The proposed method uses DEV-PCA within a generalized PCA framework suited for count data from exponential family distributions.The method projects data into a low-dimensional latent space and assesses clustering significance by comparing the goodness of fit of single versus mixed Gaussian models on the projected data, avoiding direct covariance estimation challenges.
- A complexity and runtime analysis of the proposed method is missing.
- While comparisons to variants of SigClust and scSHC are presented, the paper doesn’t include comparisons to other recent clustering significance methods for count data.
@misc{
dai2024statistical,
title={Statistical Significance of Clustering for High-Dimensional Count Data},
author={Yifan Dai and Di Wu and Yufeng Liu},
year={2024},
url={https://openreview.net/forum?id=tWgmOFfcQ1}
}
Clustering is widely used in biomedical research for meaningful subgroup identification. However, most existing clustering algorithms do not account for the statistical uncertainty of the resulting clusters and consequently may generate spurious clusters due to natural sampling variation. To address this problem, the Statistical Significance of Clustering (SigClust) method was developed to evaluate significance of clusters in high-dimensional data. While SigClust has been successful in testing mixtures of continuous distributions, it is not specifically designed for discrete distributions, such as count data in genomics. Moreover, SigClust and its variations often suffer from reduced statistical power when applied to non-Gaussian high-dimensional data. To overcome these limitations, we propose SigClust-DEV, a method designed to evaluate the significance of clusters in count data. Through extensive simulations, we compare SigClust-DEV against other existing SigClust approaches across various count distributions and demonstrate its superior performance. Furthermore, we apply our method SigClust-DEV to Hydra single-cell RNA sequencing (scRNA) data and electronic health records (EHRs) of cancer patients to identify meaningful latent cell types and patient subgroups, respectively.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
~Yifan_Dai1 ~Di_Wu52 ~Yufeng_Liu2
Yifan Dai Di Wu Yufeng Liu
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Unsupervised learning Cluster index Generalized PCA Dimension reduction High-dimension low-sample size data
I certify that there is no acknowledgement section in this submission for double blind review.
dai|statistical_significance_of_clustering_for_highdimensional_count_data
/pdf/ae27ae156229c52b455cc340541160d85ee4f994.pdf
unsupervised, self-supervised, semi-supervised, and supervised representation learning
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/4660032493ae0e29561171c8d9a82a62f6c0f38f.zip
Statistical Significance of Clustering for High-Dimensional Count Data
ICLR 2025 Conference Withdrawn Submission
ICLR.cc/2025/Conference/Withdrawn_Submission