Learning Multiple Semantic Views For Self-explaining Physiological Signal Stratification
Explainable artificial intelligence (XAI);Interpretable machine learning;Interpretability;Deep learning;Time Series Analysis;Segmentation;End-to-end;Self-explaining models;Physiological signals;Photoplethysmogram (PPG);Electrocardiogram (ECG);Obstructive sleep apnea (OSA);Atrial fibrillation (AF);Heart rate variability (HRV);Blood pressure (BP)
Yes
No ethics review needed.
Major: 

See above ("Weaknesses").

Minor:

1- Given the reliance on task labels to optimize segmentation, how does the model perform on tasks with sparse or noisy labels? Does this affect interpretability? It would be interesting if authors could've addressed that and potentially compare it with the SOTA method.
1- The multi-view segmentation approach is an innovative contribution, adding potential value to explainability in machine learning for healthcare, where interpretability is crucial.

2- The paper proposes a unified architecture applicable to both classification and regression tasks, which shows adaptability to a variety of physiological signal processing tasks.
This paper presents a multi-view deep learning model aimed at self-explaining predictions for various physiological signal-based tasks, such as obstructive sleep apnea (OSA) and atrial fibrillation (AF) detection. The proposed model generates “semantic views” by using mask networks to isolate task-relevant regions of the input signals. These views are used to enhance interpretability and yield clinically relevant insights.
1- The paper introduces multiple semantic views (2, 3, or 4 views) but does not explain why these specific numbers of views are optimal across tasks. This arbitrary choice may limit the interpretability and generalizability of the approach. Further discussion or empirical testing regarding the impact of varying the number of views on interpretability and performance would strengthen the approach.

2- The experimental setup could have greatly benefited from ablation studies that justify the architectural decisions, such as the number of mask networks or the use of shared embedding networks. These studies would help clarify the impact of each component on the model’s performance and interpretability, providing a stronger empirical basis for the architectural choices.

3- The authors claim alignment between the generated views and clinical knowledge, yet this is primarily presented through visual inspection. Providing more robust, quantitative evaluations of interpretability, ideally verified with domain experts, would lend credibility to these claims.

4-  The results are not entirely convincing, as the proposed model fails to outperform current state-of-the-art implementations on 3 out of 4 datasets. Additionally, the ablation study in Table 1 indicates that the multi-view architecture offers only a marginal performance improvement. 

5- There is a lack of comparison with established explainability approaches like SHAP or LIME. Although these methods may not offer the same level of task-specific interpretability, a comparison would clarify the relative benefits of the proposed model. 

Minor: 

1- The naming conventions in Table 1 could be clearer. Terms like “SOTA” and “ablation” could be replaced with more descriptive labels that specify the method or configuration used, making it easier for readers to understand the comparison.
Yes
No ethics review needed.
Abstract

Methods in the Abstract do not need to be so extensive e.g., The section: “Specifically, the proposed network… to the task labels” could be omitted.

Methods

Line 181. “… each sample x in the time series S to be attributed to one of the N semantic states”.
Why should one sample be attributed to only one semantic state? Intuitively, it seems that specific parts of a physiological signal could reflect several latent semantic states.

Equation (4). By applying softmax activation at each time sample, we allow the information to leak into all masks with varying amplitudes, which deviates from the original strict binary definition. In this case, how do we know whether this information is amplified or suppressed by the subsequent embedding networks – and hence attribute explainability to the high-amplitude parts?

3.2.2. Considering that the semantic segmentation masks provide interpretability, why do we need weight sharing in the embedding network features?

3.2.2. What’s the role of the differential embedding vector? Is there any empirical evidence that the decision network can’t exploit such relationships?

Results

Table 1. It would be preferable to report AUC metrics instead of accuracy, considering that accuracy will be sensitive to each model and binary threshold (was there any threshold tuning?) 

Line 337. “which suggests the effectiveness… from full-time series interval”. The comparison here may not be fair, considering that removing the mask network significantly reduces the number of parameters in the model, which will solely rely on one embedding network to receive input from the original signal.

Line 370. “From Figure 3… clearly capture such information”. The heart rate variation is not very prominent in the figures. Maybe you could show smaller windows or wider X-axes?

Appendix

Line 926. “we enforce a minimum duration L”. How did you select L for each task? I don’t think these numbers are mentioned in the paper.

General

Please generate in-text citations with brackets.

From a physiological signal interpretation perspective, how do these semantic views compare to existing post-hoc explainability methods? E.g., clustering techniques at the sample level [1].

Potential Work

The assumptions behind the semantic masks (semantic states attributed to specific time samples) and the need for prior selection of the number of semantic states N may introduce limitations as a general-purpose explainability mechanism. Could the network somehow discover the optimal number of semantic states? (instead of predefining N).

References:

[1]  Boubekki, A., Fadel, S.G., & Mair, S. (2024). Leveraging Activations for Superpixel Explanations. ArXiv, abs/2406.04933.
This work presents an original idea for a generalized explainable deep learning architecture that can potentially have significant implications for AI-based medicine and XAI. Specifically, it incorporates model and sample level interpretability, by introducing a prior constraint on the number of semantic views which are trainable (model level explainability), based on which each sample produces a unique segmentation mask (sample level explainability). This is contrary to post hoc explainability techniques, where the sample-level explanation can be independent, ambiguous (model approximations), and inconsistent across techniques.
The work involves an inherently explainable AI approach for clinically relevant supervised tasks based on electrocardiogram (ECG) or photoplethysmogram (PPG) inputs. The explainability is achieved by exploiting trainable masks to identify regions of ECG/PPG contributing to clinically significant information.
The proposed deep learning architecture can be relevant for signal segmentation tasks but the level of explainability is quite coarse. The method involves qualitative (visual) exploration of the learned masks that may be quite difficult for slightly more complex tasks. This is also evident from the fact that performance is only optimum for 2 or 3 masks, with the design preventing the integration of multi-dimensional concepts. Moreover, the learned views do not necessarily seem to provide unique insights into model explainability, without knowing which semantic states, and which part of the signals in each mask, contribute to the networks’ decisions (e.g., in the example of AF, the presence or absence of P waves may be more indicative for the detection of the disease, than actual QRS peaks). The selection of tasks is also quite limited in showing interpretability properties, considering that all tasks in the paper are defined as conditions related to peak-to-peak interval variability.
Yes
No ethics review needed.
See above
- The research topic of this paper focuses on the interpretability of medical artificial intelligence, which is a field of great concern and has significant practical importance.

- The method proposed in this paper maps different parts of the input signal to different semantic state spaces, revealing hidden patterns in the input signal that are related to model decisions, thereby enhancing the model's interpretability.

- This paper has been validated on multiple datasets, and the experimental results show that the model's decision focus aligns with domain knowledge, verifying the effectiveness of the method.
This paper introduces a self-explaining deep learning model architecture designed to enhance interpretability in the analysis of physiological signals, an issue often overlooked in existing deep models. The architecture employs a multi-semantic view approach, which generates multiple mask-modulated signal versions through a mask network. This process attributes model inputs to distinct semantic states, uncovering hidden patterns within the input data. The paper tests this architecture on four clinically relevant tasks involving ECG or PPG signals for classification and regression. Experimental results indicate that the multi-view approach demonstrates improved model interpretability, providing clearer insights into the model's decision-making process.
- Data diversity: The dataset used in this article is limited to a single type of physiological signal, utilizing either ECG or PPG signals exclusively (although differentiated PPG signals were employed). This limitation raises questions about the effectiveness of the proposed method when applied to mixed types of physiological signal inputs, which warrants further validation.
- Semantic state complexity: The number of semantic states in the paper is relatively small (2, 3, or 4). For complex inputs or tasks, a limited number of semantic states may not adequately reflect the model's decision-making process. The performance of the model with a higher number of semantic states requires further investigation.
- Visualization challenge: The visualization results are discernible when the number of semantic states is small (e.g., 2). However, as the number of semantic states increases, these visualizations become difficult to recognize effectively. This can lead to a decreased understanding of the model's decision focus, thereby reducing the model's interpretability.
- Evaluation metrics: There are concerns with the evaluation metrics used in the dataset. In classification problems, accuracy is employed as the evaluation metric, but this metric is susceptible to the impact of class imbalance. More robust metrics, such as AUC or F-score, should be considered for a more reliable assessment.
- Temporal data representation: The method proposed in the paper classifies semantic states for individual sample time points. However, data from a single time point may not capture sufficient semantic information, especially when the signal sampling frequency is high, which could limit the representation of meaningful physiological information.
Yes
No ethics review needed.
1. \[Line 16\] Can you explain how xAI “ensures” reliability without casual inference study?  
2. \[Line 31\] Why do you believe validating on only 4 tasks with only 2 waveforms “displays universal usability”?   
3. \[Line 37\] Is highlighting relevant regions sufficient for transparency? How does it relate to clinical decision making? Is there any assumption to be made here for how clinicians interact with the model you developed?  
4. \[Line 328\] It seems 4-view is worse than 3-view. Is there any explanation?
The paper is generally easy to read, but its clarity can be enhanced by better diagrams.
This paper presents an architecture for processing medical waveforms with enhanced explainability. The author claims the learned representations are task-relevant and human-interpretable.
1. In general, there is no significant technical innovation specially designed for clinical applications or medical waveforms. The author should explain how the proposed method differs from previous general xAI methods and compare the performances.   
2. The author claims the method generates human-interpretable features, but the embedding and decision networks are not easily interpreted (limiting the transparency significantly).  
3. There seems to be no user study with clinicians on the relevance of extracted features.   
4. Figure 2 is too brief, consider adding some sub-figures to illustrate the ideas. It’s only about half the page width now.  
5. Some equations on Page 5 seem un-necessary, and the notation can be simplified.  
6. The tasks selected are not representative in general, and the SOTA methods cited are old in general.   
7. The ablation is only limited to the number of views.   
8. The results reported in Section 5.2 have strong selection bias (correctly-classified ones are shown).
We propose a generalized self-explaining multi-view deep learning architecture, that generates task-relevant human-interpretable representations during model inference, for stratifying health information from physiological signals.
@inproceedings{
anonymous2024learning,
title={Learning Multiple Semantic Views For Self-explaining Physiological Signal Stratification},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=1d8Egv45of},
note={under review}
}
Explainable artificial intelligence (XAI) offers enhanced transparency by revealing key features, relationships, and patterns within the input data that drive model decisions. In healthcare and clinical applications, where physiological signals serve as inputs to the models for decision making, such transparency is critical for ensuring reliability, identifying biases, and uncovering new insights. However, despite the potential to reveal clinically-relevant information used for inference, generalized solutions for explainability have remained limited in this domain. In this work, we propose a generalized self-explaining multi-view deep learning architecture, that generates task-relevant human-interpretable representations during model inference, for stratifying health information from physiological signals. Specifically, the proposed network architecture employs a mask network to produce multiple mask-modulated versions of the signal, referred to as “semantic views”, highlighting distinct regions of the signal that may be relevant to clinically significant information. These views offer complementary perspectives to enhance interpretability and feature extraction. A shared embedding network is used to extract task-related features from each semantic view, which are used to produce the model's output. Through supervised training with labels, each semantic view is updated based on the saliency information between the semantic view and the model's output, toward fitting the model's output to the task labels. Validated on 4 different clinically-relevant classification and regression tasks taking electrocardiogram (ECG) or photoplethysmogram (PPG) as input, the proposed multi-view architecture displays universal usability, achieving comparable or superior performance across all tasks, when compared to state-of-the-art methods designed for each task. Unlike current state-of-the-art models, which lack task-agnostic human interpretability, our model uniquely provides interpretable outputs. As it is shown, the semantic views generated by the proposed model highlight task-specific characteristic regions in the input signal, aligning closely with the domain knowledge of human experts for each task. Overall, the proposed method offers new directions for interpretable machine learning and data-driven analysis of physiological signals, envisioning self-explaining models for clinical applications.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Explainable artificial intelligence (XAI) Interpretable machine learning Interpretability Deep learning Time Series Analysis Segmentation End-to-end Self-explaining models Physiological signals Photoplethysmogram (PPG) Electrocardiogram (ECG) Obstructive sleep apnea (OSA) Atrial fibrillation (AF) Heart rate variability (HRV) Blood pressure (BP)
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/6b15d200913305505c5065677bb6970308669a7f.pdf
interpretability and explainable AI
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Learning Multiple Semantic Views For Self-explaining Physiological Signal Stratification
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission