ToRL: Topology-preserving Representation Learning Of Object Deformations From Images
Representation Learning;Deformations;Topology
Yes
No ethics review needed.
1.	Please explain and verify the key formula proposed by this work. And explain the originality of the formula. For example, in formula (2), what is the second part? What is the relation to LDDMM?
2.	Please give more qualitative results, especially for 3D Brains database.
The work proses a novel representation learning to preserve object topology in deformation. The whole paper is well-written.
This work presents a representation learning for image deformations by learning transformation groups in the latent space, and innovates the preservation of topology of object in the decoder by incorporating a smooth group composition module. Experiments on various databases along with the comparison with SOTA models are given.
1.	The descriptions and proofs of the given formula (2), (5), (6) are insufficient. Readers cannot fully understand the reason of the design.
2.	The qualitative experiments results are incomplete. No figures show the results on 3D Brains.
Yes
No ethics review needed.
See the weaknesses section.
1.	The technical contribution is novel and well-formulated, with a clear mathematical foundation for the transformation groups and their properties in the latent space.
2.	The elimination of the reference image requirement during the inference addresses a practical limitation in existing methods, making the approach more applicable to real-world scenarios.
3.	The experimental validation is comprehensive.
This paper introduces ToRL, a novel topology-preserving representation learning model for capturing object deformations from images. Unlike existing deep neural networks that primarily focus on visual features, ToRL explicitly models object topology in the latent feature space through learned transformation groups. The model incorporates a novel decoder architecture with a smooth composition module to preserve topological properties during the learning process. Notably, ToRL eliminates the need for reference images during inference, which is a limitation in existing approaches. The authors validate their method through extensive experiments on multiple datasets, including 2D shapes and 3D medical images, demonstrating superior performance in classification tasks and better preservation of topological properties compared to state-of-the-art methods.
1.	The mathematical formulation, while thorough, could benefit from more intuitive explanations or visualizations to help readers better understand the paper.
2.	The individual contributions of different components within the ToRL architecture are not analyzed. In particular, how different choices of transformation groups might affect the model's performance is not investigated.
3.	Although the paper claims superiority in preserving topological properties, additional metrics for assessing topological preservation are needed.
4.	The paper lacks a detailed analysis of the model's robustness to different types of input perturbations or variations in image quality, which is particularly relevant for medical imaging applications where image acquisition conditions can vary significantly.
5.	Beyond classification, are there any downstream tasks that could better showcase the capabilities to preserve the topology?
Yes
No ethics review needed.
See weakness. Please clarify if I've misunderstood.
1. The overall approach is somewhat inspiring and can essentially be regarded as an SVF  in the feature space.
2. The experiments demonstrate the effectiveness of the proposed representation learning method by showing improvements in downstream classification tasks
The paper presents a novel model and method for image representation that aims to preserve topological information. The authors highlight two main contributions: (i) developing an explicit mechanism for maintaining topological integrity within the latent space, and (ii) integrating a smooth group composition module into the skip connections of a U-shaped network to ensure topology preservation. The performance of ToRL is compared with other methods on downstream classification tasks. However, it should be noted that only classification tasks were evaluated. The main issue with this paper is that everything is artificial: the data, the tasks, and the method are all designed based on these artificial settings.
1. Lack of real-world applications: The data, tasks, and methods used are all based on artificial settings, similar to early spatial transformer models. Although diffeomorphism is introduced to address classification task with spatial distortion, there is no extensive exploration of SO(3) transformations or other variations, despite substantial literature in this area. There are no experiments involving real applications related to diffeomorphisms, such as registration. The classification experiments are overly simplistic, and there is no post-hoc analysis to determine if the model truly preserves topology. In fact, due to the discrete errors in SVF, it is not theoretically a true diffeomorphism, yet no analysis is provided. As a result, this paper is neither theoretical nor practical.

2. Poor writing structure and unclear contributions: The paper spends considerable space discussing diffeomorphisms, which are not directly related to its contributions, without clearly highlighting what has been contributed. The design of TGM, which could be a key part of the method, is barely mentioned. In contrast, irrelevant network architecture details with many similarities to existing models (e.g., UNet, UNet++) are overly emphasized.

3. Factual errors or lack of evidence: There is a significant factual error regarding AdrenalMNIST3D, which is a binary shape dataset, but the paper incorrectly refers to it as "3D Abdominal MRIs." If the author have visualized the data, no one will make mistakes on distinguish binary shape and MRI. In fact, even for the source, the shape is from CT scans, not MRI. This raises concerns about other potential factual errors that I may not find. Furthermore, the claim that "our approach can be easily applied to other parameterizations of diffeomorphisms" is unsupported. TGM is not adequately described, making it difficult for readers to understand its details, and it is questionable whether other NeuralODE-based methods can be seamlessly integrated into this approach.

4. Computational cost not reported or compared: The paper does not compare the parameter count and computational load against state-of-the-art methods, which may result in unfair comparisons. Additionally, the experiments do not provide comparisons of the model's parameter count and computational load (e.g., FLOPS) before and after incorporating the smooth group composition module. Therefore, it is unclear whether the observed performance improvements are due to the proposed module or simply an increase in parameters and computational cost.
Yes
No ethics review needed.
It would be great if the authors could explain more on the computational complexity of the proposed method, and evaluate on more diverse real-world datasets.
1. ToRL explicitly preserves geometric and topological consistency throughout the representation learning process, which is essential for high-stakes applications such as medical imaging and 3D modeling.

2. Unlike many previous methods, ToRL eliminates the need for reference images during inference, making it more practical and efficient for real-world applications.

3. The decoder’s design with smooth transformations ensures structural continuity and smoothness, addressing the challenges of traditional feature fusion methods like simple concatenation or addition.

4. The results look good to me as it improves the classification performance and the ablation study is comprehensive.
Existing deep learning methods focus on visual features (like intensity or texture) but fail to preserve geometric and topological structures of objects, which is crucial for applications in medical imaging and 3D modeling. The paper introduces ToRL, a new topology-preserving representation learning framework that models complex object deformations directly from images without relying on a reference image during inference.

contributions:

1. The proposed method models intricate geometric deformations in the latent space using learned transformation groups.
This latent space representation preserves structural and topological integrity during training and decoding.

2. The decoder architecture integrates skip connections with a novel smooth group composition module. This ensures that deformations remain smooth and topologically consistent across network layers.

3. Unlike other models that require a reference image for deformation prediction, ToRL removes this dependency, improving practical usability.
1. I am concerned with the complexity. The incorporation of group transformations in the latent space and smooth group composition can increase computational overhead, making the method slower for large-scale datasets or real-time applications.

2. The custom decoder design and latent transformation modules may make it more difficult to integrate with standard architectures (like ResNet or UNet) without extensive modification.

3. Although ToRL is validated on several datasets, it might benefit from additional tests on larger or more diverse real-world datasets to further demonstrate its robustness and generalizability.

4. The strong focus on topology preservation could lead to overfitting in scenarios where topological consistency is not essential, potentially reducing the model’s flexibility.
ToRL: Topology-preserving Representation Learning
@inproceedings{
anonymous2024torl,
title={To{RL}: Topology-preserving Representation Learning Of Object Deformations From Images},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=rUqcugZDUl},
note={under review}
}
Representation learning of object deformations from images has been a long-standing challenge in various image or video analysis tasks. Existing deep neural networks typically focus on visual features (e.g., intensity and texture), but they often fail to capture the underlying geometric and topological structures of objects. This limitation becomes especially critical in areas, such as medical imaging and 3D modeling, where maintaining the structural integrity of objects is essential for accuracy and generalization across diverse datasets. In this paper, we introduce ToRL, a novel *Topology-preserving Representation Learning* model that, for the first time, offers an explicit mechanism for modeling intricate object topology in the latent feature space. We develop a comprehensive learning framework that captures object deformations via learned transformation groups in the latent space. Each layer of our network's decoder is carefully designed with an integrated smooth composition module, ensuring that topological properties are preserved throughout the learning process. Moreover, in contrast to a few related works that rely on a reference image to predict object deformations during inference, our approach eliminates this impractical requirement. To validate ToRL's effectiveness, we conduct extensive multi-class classification experiments across a wide range of datasets, including synthetic 2D images, real 3D brain and abdominal MRIs, and 3D chest CT scans. Experimental results demonstrate that ToRL outperforms state-of-the-art methods, setting a new way to enforce topological consistency in representation learning.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Representation Learning Deformations Topology
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/e92ef0c37dbd2f41a1eb377893209dadc7cc5bcc.pdf
applications to computer vision, audio, language, and other modalities
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
ToRL: Topology-preserving Representation Learning Of Object Deformations From Images
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission