A mechanistically interpretable neural network for regulatory genomics
interpretability;mechanistic interpretability;attention;convolution;regulatory genomics
Yes
No ethics review needed.
- For the evaluation strategy, why do you choose chr8 and chr10 for validation and chr1 for testing? Have you considered to use leave-one-out strategy to assess the model's generalization across different genomic regions?
- Could you provide details on the computational resources required to train ARGMINN?
- The proposed ARGMINN model brings the mechanistically interpretable architecture into a classical DNN architecture, trying to address the Interpretability challenge in applying deep learning to genomics.
- The authors provide theoretical proofs showing that their model can recognize all motif configurations.
- ARGMINN shows superior performance  across all tasks, compared to baselines (e.g. CNNs and ExplaiNN). And the authors also showcase the model's ability to generate novel functional sequences based on the learned motifs, which is a valuable contribution.
The paper introduces ARGMINN, a novel DNN architecture designed for recovering motifs with mechanistic interpretability. The model is designed to directly encode biologically meaningful motifs in its weights and activations. Exhaustive experiments show ARGMINN's strength in motif discovery, instance calling, robustness, and interpretable sequence generation. This work successfully narrows the gap between the high predictive performance of DNNs and the need for interpretability in genomics prediction.
- The evaluation strategy used in the paper involves reserving chr8 and chr10 for validation and chr1 for testing, while training on all other chromosomes. However, because chromosomes can vary in genomic features, using a specific chromosome split might introduce biases in performance evaluation.
- Since the paper introduces a memory stream into the attention mechanism, it would be helpful to include a discussion on the training times and memory usage of the model.
Yes
No ethics review needed.
The most uncertain parts for me are the contributions and the detailed experimental settings of the proposed method.
The paper is targeting at an important task, and shows many cases for each evaluated task, which is straightforward.
This paper proposes a mechanistically interpretable neural network to solve several genome understanding tasks, including regulatory function prediction, DNA motif discovery and motif interaction prediction. The proposed architecture consists of a motif-scanner, a regularizer and a syntax builder to respectively recognize motifs, filter out wrong patterns and predict interactions between motifs. The paper did many analyses to show the discovered motifs, motif instance calling, QTL prioritization and the architecture robustness.
1. The paper is hard to follow. After reading the manuscript, I know the authors develop a new architecture consisting of several components, and each of them achieves a specific function. However, I cannot figure out the detailed contributions of this paper. That is to say, what are the differences of the proposed architecture compared to previous method?

2. The experimental settings and results are not complete.:

2.1 The paper didn't show any specific number on the evaluated tasks. All results are shown in Figure. Though we could see some improvements compared to baselines, we still don't know what specific performance the proposed model can achieve. 

2.2 The paper lacks ablation study.

2.3 The paper lacks specific experimental settings. For example, what are the specific values for n_f and n_L?  Do the standard CNN have the same layer as ARGMINN?

2.4 What species genome sequences are used for each task?
Yes
No ethics review needed.
1. Could you please explain more about the connection between ARGMINN and CBMs?
2. Could you please explain more about the difference between ARGMINN and ExplaiNN?
1. This paper successfully applied the MI methods to the regulatory genomics domain
2. This paper provided thorough assessment for the usage of ARGMINN
3. The authors provided detailed related works and theoretical results based on first-order logic
This paper designed a novel mechanistically interpretable architecture for regulatory genomics, where motifs and their syntax are directly encoded and readable from the learned weights and activations. Through several experiments, the authors show that ARGMINN excels in
de novo motif discovery and motif instance calling, is robust to variable sequence contexts, and enables fully interpretable generation of novel functional sequences
1. I find this work may be not interesting to the most readers of ICLR. This paper should fall into a biological journal (e.g. journals for stastical geomics)
2. The technologies introduced in this paper are actually not based on biological mechanics but common mechanical Interpretation tricks including regularizations, separate convolutions and attention for interpretability.
Yes
No ethics review needed.
- What specific advancements does this work provide over existing models in mechanistic interpretability and regulatory genomics?
- Can the authors elaborate on their validation methodology and why they chose not to compare with established baseline methods?
- Relevant Research Area: The focus on regulatory genomics is timely and addresses a critical need for interpretable models in biological applications.
- Potential Applications: The proposed methods may have applications in understanding gene regulation mechanisms, which is valuable for both computational biology and medicine.
This paper presents a neural network model aimed at providing mechanistic interpretability within the field of regulatory genomics. While the topic is relevant and important, the work suffers from several significant shortcomings that undermine its contributions and overall impact.
- The approach lacks sufficient novelty compared to existing methods in the field, e.g., DNABERT, NT, HyenaDNA, EVO, et al. The authors do not convincingly demonstrate how their work significantly advances the state of the art in mechanistic interpretability or regulatory genomics.

- The experimental validation is inadequate. The authors fail to perform comprehensive comparisons with baseline methods or other relevant approaches. Without robust benchmarks, it isn't easy to ascertain the practical utility of the proposed model.

-  The conclusions drawn from the results are often overstated and not sufficiently supported by the data. The authors claim significant interpretability and performance improvements without adequate evidence to back these assertions.
Yes
No ethics review needed.
- How would open chromatin and variant data be incorporated into the model? How does it perform compared to existing work?
- How does the presented approach compare to existing DL-based TF binding prediction methods and established attribution methods?
- Why is it better to use an (inaccurate) inferred motif than detecting motif occurrence and then building a classifier based on that?
- How is prediction performance affected by the architecture compared to existing work (including non-DL based methods)?
- The proposed architecture seems novel and thought-through.
- The methodological part is well written and easy to follow.
The authors consider the problem of understanding the transcription factor—DNA binding code in terms of actual binding motifs in the genome. Through a mechanistically interpretable neural network design for the prediction of protein binding events, they ensure that biologically meaningful binding motifs can be learned, showing this ability on synthetic and real data.
- The assumptions made in this work are prohibitively restrictive: 
1) recent efforts, including large-scale consortium-based benchmarking in ENCODE-DREAM challenge [1], have shown that Epigenetics (e.g., openness of chromatin) play a decisive role in the binding of transcription factors and need to be taken into account for accurate prediction [2], a versatile set of tools has hence been designed including [3] to appropriately consider such data;
2) Genomes are unique to individuals and variants in individual genomes play a major driver in diseases such as cancer, often interrupting TF binding due to their location in motifs. Hence, recent tools consider such variants for accurate and actual genome-specific binding [4].
For both, open chromatin and variant data, how would the model incorporate this essential knowledge? How does it perform compared to existing work?
- There is a plethora of deep learning-based tools for predicting TF-binding [5,6,7,8], how does the presented approach compare to them quantitatively? With generic attribution methods, such as layer-wise-relevance propagation or SmoothGrad, extraction of motif sequences that the models respond to can be similarly achieved for these deep architectures – are your motifs qualitatively and quantitatively (e.g. similarity between discovered and known motif) better?
- It is unclear why motifs need to be learned, as there exist extensive motif databases (TRANSFAC, JASPAR, ...) that were generated through rigorous (wet-lab) experiments. Why is it better to use an (inaccurate) inferred motif than detecting motif occurrence and then building a classifier based on that? The paper would benefit from a use-case where the existing databases can not help (e.g., TFs where motifs are not available, or relevant species were no database is available).
- The quality of prediction is not properly evaluated against existing methods (including non-DL models), it is hence unclear whether the interpretability is traded off for prediction quality that would harm downstream applications. A proper comparison and evaluation in that regard would improve the paper.

[1] https://www.synapse.org/Synapse:syn6131484/wiki/402037, and associated conference tracks at RECOMB/ISCB 2016

[2] J Keilwagen, S Posch, J Grau, Accurate prediction of cell type-specific transcription factor binding Genome Biology 2019

[3] F Schmidt, F Kern, MH Schulz, Integrative prediction of gene expression with chromatin accessibility and conformation data Epigenetics & Chromatin 2020

[4] R Steinhaus, PN Robinson, D Seelow, FABIAN-variant: predicting the effects of DNA variants on transcription factor binding Nucleic Acids Research 2022

[5] L Cao et al., Prediction of Transcription Factor Binding Sites Using a Combined Deep Learning Approach Frontiers in Oncology 2022

[6] N Ghosh et al., Predicting Transcription Factor Binding Sites with Deep Learning Int J Mol Sci 2024

[7] C Chen et al., DeepGRN: prediction of transcription factor binding site across cell-types using attention-based deep neural networks BMC Bioinformatics 2021

[8] GB Kim et al., DeepTFactor: A deep learning-based tool for the prediction of transcription factors PNAS 2020
We designed a neural network for DNA sequences, which reveals motifs and syntactical rules from its weights and activations after training.
@inproceedings{
anonymous2024a,
title={A mechanistically interpretable neural network for regulatory genomics},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=eR9C6c76j5},
note={under review}
}
Deep neural networks excel in mapping genomic DNA sequences to associated readouts (e.g., protein–DNA binding). Beyond prediction, the goal of these networks is to reveal to scientists the underlying motifs (and their syntax) which drive genome regulation. Traditional methods that extract motifs from convolutional filters suffer from the uninterpretable dispersion of information across filters and layers. Other methods which rely on importance scores can be unstable and unreliable. Instead, we designed a novel mechanistically interpretable architecture for regulatory genomics, where motifs and their syntax are directly encoded and readable from the learned weights and activations. We provide theoretical and empirical evidence of our architecture's full expressivity, while still being highly interpretable. Through several experiments, we show that our architecture excels in de novo motif discovery and motif instance calling, is robust to variable sequence contexts, and enables fully interpretable generation of novel functional sequences.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
interpretability mechanistic interpretability attention convolution regulatory genomics
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/f3b8602246ac8b060f15524503c363983d5e0ac1.pdf
interpretability and explainable AI
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/7703bf447a32650a195791f34e83d33d40898bec.zip
A mechanistically interpretable neural network for regulatory genomics
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission