Grad-TopoCAM: EEG Brain Region Visual Interpretability via Gradient-Based Topographic Class Activation Map
Electroencephalogram;Class Activation Map;Deep Learning;Visualization;Interpretability
Yes
No ethics review needed.
Please refer to the weaknesses.
1. The proposed model can be integrated into different EEG decoding models to enhance their interpretability. It is a universal interpretability and visualization method.
2. The proposed model has been validated on various DL methods and datasets.
This paper proposes the Grad-TopoCAM for enhancing the interpretability of deep learning-based EEG decoding models. It maps the gradients of feature maps to specific brain regions and facilitates channel selection across different EEG tasks. The proposed method is validated on eight DL models and four public datasets. Experimental results demonstrate its effectiveness.
1. Grad-CAM has been widely adopted for feature visualization including for EEG decoding models. The contributions of the proposed method compared with other visualization methods are not clear.
2. The proposed Grad-TopoCAM is employed for visualization analysis on the model with the highest accuracy for each subject. However, it’s noticed that the visualized features can be very different across subjects. In addition to the individual variability, are the learned features related to the models? Is it a fair comparison for the features learned by different models?
3. Although visualization is important for interpreting results, the proposed method does not enhance decoding performance or provide unique neuroscience insights. The authors may consider either improving its methodological novelty or deepening its neuroscience contributions.
Yes
No ethics review needed.
see weaknesses
1. The paper attempted to address the explainability issues for EEG deep learning research which is a key gap in the field.
2. The paper has good structure and clarity of writing in general.
3. The figures are informative and clear.
The paper proposed Grad-TopoCAM, which is an explainable AI method to identify and visualize brain regions that significantly influence decoding outcomes. The method was evaluated on multiple EEG datasets and provided with visualizations.
1. In the related work section, it is unclear why 'employing a two-dimensional convolutional structure' is a limitation as this is a common approach for most of the works in the EEG field.
2. The key weakness is that there is no comparison to the state-of-the-art or any other work in the field. For a typical explainable AI work, there should be comparison with other existing explainability methods and demonstrate how the proposed work is superior. It is unclear how the performance of the proposed method really differ from the regular Grad-CAM in general. 
Some of the baselines for comparison can be considered: LIME, Grad-CAM, GNN-Explainer, Attention-based methods etc.
3. In section 4.3 discussion of dataset III and IV. it is unclear how the patterns of brain activations are 'similar' when the topography plots are clearly different. Even if the topography plots are similar, the Chinese characters and English words have different meaning so it is not possible to justify there is common cognitive processing mechanisms between the two languages in this case.
4. In section 5.2, the channel selection results have high variations, the 20% increase for subject 6 is not generalizable to other subjects or datasets and there is no significance measurement for the effect of channel selection. It is unclear how effective or ineffective the channel selection method is.
5. There is a lack of ablation studies to prove the importance of those channels-identified. For instance, if those channels were removed, there should be a significant drop of classification performance.
Yes
No ethics review needed.
What specific metrics will be used to evaluate the effectiveness of Grad-TopoCAM compared to existing visualization techniques?

How do the authors plan to quantify the significance of the feature attributes revealed by Grad-TopoCAM in relation to classification accuracy?
Grad-TopoCAM represents a significant effort to improve the interpretability of deep learning models in the context of EEG data.

The method's approach to directly mapping feature maps to brain regions offers a novel perspective on understanding model outputs and could facilitate advancements in neurotechnology research.
This paper introduces Grad-TopoCAM, a novel method designed for visualizing brain region activation in EEG decoding using gradient-based localization. The primary goal is to enhance the interpretability of deep learning models applied to EEG data by directly mapping feature maps generated by these models to specific brain regions. However, the effectiveness of this visualization method has not been thoroughly validated. The experiments presented largely focus on evaluating the performance of different EEG decoders, resulting in unclear contributions from this research.
The validation of the effectiveness of the visualization method is insufficiently addressed, limiting the overall impact of the research.

The experiments mainly assess the performance of various EEG decoders without establishing the unique contributions of Grad-TopoCAM.

A comparison with established post-hoc explanation techniques, such as Grad-CAM and SmoothGrad, is lacking, which would help contextualize Grad-TopoCAM's performance and effectiveness.
Yes
No ethics review needed.
Please see the weakness.
The motivation, enhancing interpretability in DL models for EEG decoding adaptively, is strong and interesting.

The proposed methods, Grad-TopoCAM, can generate visualizations of salient brain region features from DL models without requiring modifications to the architecture or retraining.
To solve the issue that existing EEG interpretability researches fail to fully utilize raw signals and lack extensibility to other Deep Learning (DL) models, this paper proposes a novel framework, Grad-TopoCAM, to enhances interpretability in DL models for EEG decoding adaptively. Grad-TopoCAM has been validated across eight different DL models and four publicly available datasets, with the salient brain features aligning with established findings in cognitive neuroscience.
The reviewer has some concerns about the technical contributions of this paper. The proposed method is very simple. CAM is a highly classical method that has been thoroughly explored in other fields. This paper merely extends its application to the visualization of EEG brain region features, with limited technical innovation.

The experimental setup is not clearly delineated; for instance, the hyperparameters for training and testing each model are not thoroughly detailed, and the dataset partitioning method is not explicitly described.


The writing of this paper has significant room for improvement. Some unnecessary section titles, such as Acknowledgments and Appendices, should not be included. The tables are not aesthetically pleasing; why not omit the percentage sign (%)? The displayed brain region topology maps have low resolution, making the content difficult to discern. Why not use vector graphics to render the brain region topology maps?
@inproceedings{
anonymous2024gradtopocam,
title={Grad-Topo{CAM}: {EEG} Brain Region Visual Interpretability via Gradient-Based Topographic Class Activation Map},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=FHQDCQFD8y},
note={under review}
}
The visualization and interpretability of electroencephalogram (EEG) decoding significantly contribute to brain-computer interfaces (BCI) and cognitive neuroscience. Although some existing research has attempted to map EEG features to specific brain regions, these approaches fail to fully utilize raw signals and lack extensibility to other Deep Learning (DL) models. In this work, Grad-TopoCAM (Gradient-Based Topographic Class Activation Map) is proposed, which enhances interpretability in DL models for EEG decoding adaptively. Grad-TopoCAM calculates the gradient of feature maps for the target class at the target layer. The weights of the feature maps are obtained through global average pooling of the gradients. The class activation map is generated by performing a linear combination of weights and feature maps, which is subsequently mapped to different brain regions. Grad-TopoCAM is validated across eight DL models on four public datasets. Experimental results indicate that Grad-TopoCAM effectively identifies and visualizes brain regions that significantly influence decoding outcomes, while also facilitating channel selection for different decoding tasks. The code and data are open-source.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Electroencephalogram Class Activation Map Deep Learning Visualization Interpretability
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/0decf899c4058c13ae2da7fa63747f35017a7b96.pdf
interpretability and explainable AI
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Grad-TopoCAM: EEG Brain Region Visual Interpretability via Gradient-Based Topographic Class Activation Map
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission