SymCL: Riemannian Contrastive Learning on the Symmetric Positive Definite Manifold for Visual Classification
Learning with Manifolds;Self-Supervised Learning;Classification
Yes
No ethics review needed.
As mentioned weakness part, the submission need to have some comparison studies to show its advantage.
This submission is well written and easy to follow. The idea is clear. Experiments are conducted on multiple tasks.
This submission proposed a method combining Symmetric Positive Definite (SPD) as feature descriptor into contrastive learning (CL) for classification. A Riemannian triplet loss is proposed to guide the training process. Experiments are conducted on four datasets including AFEW, MDSD, YTC, and the Virus.
The idea is very straightforward by combining existed SPD and CL. Novelty is very limited. Although some ablation studies are performed, it still need to have some comparison to SOTA methods.
Yes
N/A
No ethics review needed.
1.	It is unclear whether the compared methods utilize the same basic backbone in Tab 2? What are the parameter numbers of different methods? 

2.	The author would better compare the proposed data augmentation methods with traditional one in the image space.

3.	The author would better analyze and compare the differences between contrastive learning loss and RML loss.
+: The paper tries to apply contrastive learning on SPD manifold, and introduces some data augmentation techniques.

+: Experiments show the proposed method achieves good performance.
This paper argues that the inherent dependence on labels in supervised learning makes learning on SPD manifold vulnerable to the effect of label noise. Therefore, the authors apply contrastive learning on SPD manifold. Meanwhile, they believe that traditional data augmentation methods are not suitable for SPD manifold, and introduce four data augmentation techniques. Additionally, a RML loss is combined to train SPD networks. The experiments are conducted on four different datasets.
-: The technical novelty of the proposed method seems limited. 

Firstly, the original contrastive learning is directly applied on SPD manifold without clear changes or improvement. Besides, this paper claims that traditional augmentation methods are unsuitable for SPD networks. However, no baseline is compared. 

Secondly, the authors should clarify that what are differences between the proposed RML loss and work [1]? Besides, RML loss shares a similar concept with InfoNCE, where both of them aim to bring anchor samples closer to positive samples and push them further from negative samples. Therefore, why they are complementary? 

-: The experimental descriptions seem not very clear. 

Specifically, it is unclear which dataset was used for pre-training, the detailed setup of the pre-training phase, and the approach taken for training on downstream tasks. For example, is the entire network trained, or is only the classifier fine-tuned? 

Moreover, based on the experimental results, the performance improvements brought by the proposed method are not significant. The performance of the MDSD and AFEW datasets is inferior to the results mentioned in the paper [1], yet these findings are not clearly discussed in the current paper. 

The paper explains that the proposed method performs poorly on the Virus dataset as "This is mainly because the Virus is a small-scale dataset, which has been verified to be more suitable for the lightweight SymNet."  Therefore, does basic backbone heavily affect the final performance? If so, the authors would better compare different methods by using the same basic backbone.

[1] WANG R, WU X J, CHEN Z, et al. Learning a discriminative SPD manifold neural network for image set classification[J/OL]. Neural Networks, 2022: 94-110.
Yes
No ethics review needed.
See the above weakness.
This paper writes a clear background.
This paper transfers contrastive learning from Euclidean space to Riemannian manifolds. They replace Euclidean similarities in the contrastive loss with Riemannian distances. They use four datasets to verify the effectiveness.
1. The motivation and advantages of this method are not clear. why do we need the contrastive learning loss for SPD manifolds? The label noise is not a special issue for SPD manifolds.

2. The novelty is limited. It seems that this paper simply replaces the Euclidean similarity with Riemannian distances.

3. The experiments are too weak. Only using four datasets that are somewhat out of data.

4. What is the application of this method? How can the SPD contrastive learning help the community?
Yes
No ethics review needed.
Please see the weaknesses.
1. A combination is given by using SPD and CL.
2. A novel Riemannian triplet loss is introduced for the proposed method.
3. Some data augmentation methods are proposed.
ymmetric positive definite (SPD) is an effective technique for data information extraction, which encodes spatiotemporal statistical information with a curved Riemannian manifold. To utilize the property, the paper combines SPD and contrastive learning (CL) together to form a framework. A Riemannian triplet loss-base loss is used for the proposed method. Some experiments have been conducted to verify the performance of the proposed method.
1.	The proposed method is a combination of SPD and CL, using a different metric for the loss function. The novelty is not enough. Why did the authors introduce SPD into contrastive learning without providing a good motivation, but now it seems that it's just a combination of the two.
2.	Figure 1 directly shows the learning process of the proposed method, from which we can see that the proposed method just is RML adds CL.
3.	Some definitions of letter variables are not provided, and the algorithm flow for this method is also not given, such as what are the inputs and outputs? The designed four augmentation methods cannot be considered as a major contribution.
4.	Many experimental details were not provided, such as experimental settings, experimental environment configuration, and comparison methods.
5.	The parameter sensitivity analysis and convergence analysis have not been provided.
6.	Many experimental effect analyses have not been provided, such as visualization effects.
7.	In the experiments, no compared methods are used, how to effectively validate the SOTA performance of this method?
Contrastive Learning for Visual Classification Based on Riemannian Manifolds
@inproceedings{
anonymous2024symcl,
title={Sym{CL}: Riemannian Contrastive Learning on the Symmetric Positive Definite Manifold for Visual Classification},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=SLUr06QUuw},
note={under review}
}
Symmetric Positive Definite (SPD) matric has been proven to be an effective feature descriptor in the realm of artificial intelligence, as it can encode spatiotemporal statistical information of data on a curved Riemannian manifold, \textit{i.e.}, SPD manifold. Although existing Riemannian neural networks have demonstrated superiority in many scientific fields, the inherent reliance on labels within supervised learning renders them susceptible to label errors. Besides, it is insufficient to depend solely on labels to learn effective feature distributions in some complicated data scenarios. Drawing inspiration from the considerable achievements of contrastive learning (CL) across diverse tasks, we extend the conventional CL paradigm to the context of SPD manifolds, which we denote SymCL, paving the way for a novel approach in SPD matrix-based visual classification. Furthermore, we inject a Riemannian triplet loss-based Riemannian metric learning (RML) into the designed SPD manifold CL framework for the sake of improving the discrimination of the learned geometric representations. Extensive experimental results on four datasets verify the effectiveness of the proposed algorithm.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Learning with Manifolds Self-Supervised Learning Classification
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/d74b9385b8dc3efafd4dc2679df5d5b03557de49.pdf
unsupervised, self-supervised, semi-supervised, and supervised representation learning
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
SymCL: Riemannian Contrastive Learning on the Symmetric Positive Definite Manifold for Visual Classification
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission