RankNovo: A Universal Reranking Approach for Robust De Novo Peptide Sequencing
Peptide Sequencing;De novo;Reranking
Yes
No ethics review needed.
- Recently, many transformer-based de novo peptide sequencing methods have emerged, such as HelixNovo[1], InstaNovo[2], AdaNovo[3], PrimeNovo[4], GraphNovo[5], etc. The discussion of these transformer-based approaches in the introduction is insufficient.
  
- In line 270, M  represents the residue mass, but the same symbol is also used in line 306 to denote prefix mass. It would be better to add a subscript or identifier to distinguish prefix mass or, alternatively, use a different symbol to represent it.

- In the mathematical formula (7) on line 309, should  \overline{m}_{q\tilde{j}} - \overline{m}_{k\tilde{j}} be corrected to  \overline{m}_{qi} - \overline{m}_{k\tilde{j}}  to represent the prefix mass difference more accurately?

[1] π-HelixNovo for practical large-scale de novo peptide sequencing

[2] De novo peptide sequencing with InstaNovo: Accurate, database-free peptide identification for large scale proteomics experiments

[3] AdaNovo: Adaptive \emph{De Novo} Peptide Sequencing with Conditional Mutual Information

[4] π-PrimeNovo: An Accurate and Efficient Non-Autoregressive Deep Learning Model for De Novo Peptide Sequencing

[5] Mitigating the missing-fragmentation problem in de novo peptide sequencing with a two-stage graph-based deep learning model
- The paper is written very clearly and is easy to understand.
- The motivation is highly meaningful, revealing that different models have distinct advantages.
- A general framework is proposed, adaptable to any de novo peptide sequencing model.
- The experiments are thorough.
It is an interesting paper that proposes a deep learning-based reranking framework and introduces two new metrics, PMD and RMD, to characterize quality differences at the peptide and residue levels. The new framework leverages the strengths of multiple de novo peptide sequencing models to achieve improved performance through reranking.
- The discussion of transformer-based approaches in the introduction is insufficient.
- The meaning of some mathematical symbols is unclear.
Yes
No ethics review needed.
1. The definition of robustness in the paper seems somewhat ambiguous. On one hand, it appears to refer to the model's robustness to noise in mass spectrometry data (Lines 12–14, Lines 81–84), but RankNovo might not sufficient to address this issue. On the other hand, it seems to refer to the issue of having inconsistent baseline models available during training and testing phases.


2. Based on the disadvantage mentioned earlier regarding modest performance improvement, there should be experiments to demonstrate whether naive methods (instead of RankNovo) can also achieve reasonable results. For instance, during inference, for multiple predicted peptides from different base models, one could select: (1) the peptide with the highest score from a model output, (2) the most frequently predicted peptide, or (3) the peptide closest to the precursor mass, and compare the performance of these methods against RankNovo. This approach would help demonstrate that RankNovo indeed learns some knowledge from the predicted results of multiple models.
1. The paper demonstrates a high degree of novelty by proposing a method that utilizes predicted sequences from multiple de novo models, challenging the traditional single-model paradigm.
2. It achieves performance that surpasses all baselines and base models on two datasets.
3. The introduction of novel metrics such as PMD and RMD is likely the first of its kind in de novo sequencing, providing valuable reference points.
This paper presents the first deep learning-based reranking framework that enhances de novo peptide sequencing by leveraging the complementary strengths of multiple sequencing models. RankNovo scores the output sequences of multiple de novo models to train the model (training phase) or to obtain the optimal sequence through scoring (inference phase). The paper also introduces novel metrics such as PMD and RMD.
1. The performance improvement seems modest. RankNovo's peptide recall only surpasses the baseline by 0.037 (V1) and 0.023 (V2). Since RankNovo is trained and inferred based on these base models, it theoretically can only outperform them. The evaluation of RankNovo's performance should be based on its improvement relative to SOTA baselines. Otherwise, for such minor improvements, why not simply use the predictions from other models instead of inference multiple models through RankNovo?

2. There seems to be a lack of analysis regarding the parameter number, training time, and inference time of RankNovo compared to other de novo models, which should be addressed in the experimental section. Given that RankNovo requires inference results from multiple (2 to 6) other models during training and inference, it can be inferred that its training and inference times would be slower than those of other models.
Yes
No ethics review needed.
1. RankNovo incorporates six de novo sequencing models. Is there any rationale for the selection of these?
2. See weakness.
1. Introduces a unique list-wise reranking approach that effectively leverages outputs from multiple de novo peptide sequencing models.
2. Introduces PMD and RMD metrics, designed for precise quantification of mass differences between peptides.
3. The model demonstrates significant improvements over existing methods.
The paper presents RankNovo, a list-wise deep reranking framework for de novo peptide sequencing that uses outputs from multiple base models, applying axial attention and novel metrics for effective peptide reranking.
1. The approach heavily depends on outputs from existing peptide sequencing models, which may limit its novelty.
2. The conclusion is somewhat simple and could be expanded to discuss the limitations of the current approach and potential future research directions.
Yes
No ethics review needed.
Please see the questions and suggestions raised in the section Weaknesses above.
1. The paper introduces a deep learning-based reranking framework for peptide de novo sequencing, and focus on addressing the preferential bias challenges inherent in peptide sequencing.
2. The paper introduces two novel metrics, PMD and RMD, for accurate measurement of mass differences between peptides, which enable the model to more accurately distinguish complex similar sequences.
3. In the experiments, RankNovo surpasses each of its individual ensemble components on the 9-species-V1 and the 9-Species-v2 dataset, demonstrating superior performance in amino acid and peptide.
4. RankNovo generalizes effectively to unseen models in a zero-shot setting, which underscores the potential and value for future applications in de novo peptide sequencing.
The paper presents the first deep reranking framework, RankNovo, based on a list-wise reranking approach, which enhances de novo peptide sequencing by leveraging the complementary strengths of multiple sequencing models. Experimental results show that RankNovo achieves state-of-the-art performance on de novo sequencing benchmarks, outperforming each of its component base models.  Moreover, RankNovo exhibits strong zero-shot generalization to unseen models that highlight its robustness and potential.
1. The proposed RankNovo relies on the setting of multiple base models, which increases the computational cost.
2. In formula 10, L_coarse and L_fine are not clearly defined. It seems more appropriate to use L_PMD and L_RMD?
3. In formula (1) and formula (10), λ is confused.
4. The setting of λ in Equation 10 is unclear. Is the λ used in different tasks inconsistent? The author needs to clarify the setting of λ and the impact of λ on performance.
5. In order to study the influence of the number of base models and each model, you select five subsets. Could you explain the basis for sequentially removing the strongest model? Why not remove the poorest ones?
6. In Table 8, compared with the 5 models, the 6 models introduced the strongest ByNovo, but the average performance was reduced. What is the possible reason?
7. In Conclusion, there is relatively little content on the prospects and challenges of future optimization and applications, research limitations. It is suggested to supplement some to make it more comprehensive and forward-looking.

Minor issues:
1. typo error: Please confirm if the term ‘expriment’ is used correctly in the titles of Section 4 and 4.1 of the article.
2. There are three models in "The latter four models, ByNovo, R-ContraNovo, and R-ByNovo".
RankNovo is a novel deep reranking framework that improves de novo peptide sequencing by combining strengths of multiple models.
@inproceedings{
anonymous2024ranknovo,
title={RankNovo: A Universal Reranking Approach for Robust De Novo Peptide Sequencing},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=87B3zDRMjv},
note={under review}
}
De novo peptide sequencing is a critical task in proteomics research. However, the performance of current deep learning-based methods is limited by the inherent complexity of mass spectrometry data and the heterogeneous distribution of noise signals, leading to data-specific biases. We present RankNovo, the first deep reranking framework that enhances de novo peptide sequencing by leveraging the complementary strengths of multiple sequencing models. RankNovo employs a list-wise reranking approach, modeling candidate peptides as multiple sequence alignments and utilizing axial attention to extract informative features across candidates. Additionally, we introduce two new metrics, PMD (Peptide Mass Deviation) and RMD (Residual Mass Deviation), which offer delicate supervision by quantifying mass differences between peptides at both the sequence and residue levels. Extensive experiments demonstrate that RankNovo not only surpasses its individual base models, which are used to generate training candidates for reranking pre-training, but also sets a new state-of-the-art de novo sequencing benchmarks. Moreover, RankNovo exhibits strong zero-shot generalization to unseen models—those whose generations were not exposed during training, highlighting its robustness and potential as a universal reranking framework for peptide sequencing. Our work presents a novel reranking strategy that fundamentally challenges existing single-model paradigms and advances the frontier of accurate de novo peptide sequencing. Our source code is provided at an anonymous link.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Peptide Sequencing De novo Reranking
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/2aae57f6cf44eb8dc45aa7d056f675cfbbcd505e.pdf
applications to physical sciences (physics, chemistry, biology, etc.)
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
RankNovo: A Universal Reranking Approach for Robust De Novo Peptide Sequencing
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission