Multi-Scale Fusion for Object Representation
Object-Centric Learning (OCL);Variational Autoencoder (VAE);Multi-Scale;Unsupervised Object Segmentation
Yes
No ethics review needed.
What downstream tasks could this method help with? It doesn't seem to be a SAM alternative, so what is the potential practical impact?

What would change were this applied to higher-resolution images? MSF would seem to have some promise for small objects, but those are essentially all filtered out by the pre-processing.
[S1] The method seems to consistently outperform competitors for the OCL benchmarks, and is even somewhat competitive with the foundation model baseline (DINOSAUR).

[S2] The approach is well-motivated.

[S3] Figure 3 effectively demonstrates, qualitatively, how the MSF accomplishes better OCL, that is, features that are better connected to the objects themselves.
The paper proposes multi-scale fusion (MSF) for object-centric learning. Specifically, MSF extracts VAE representations corresponding to the same input, downsampled to varying resolutions. The output representations are then upsampled and downsampled as necessary and then combined as a way to augment each set of features. The augmented features can then be fed as input to the general OCL decoder (along with the slot attention outputs and the matching entries from the discrete codebook). This intends to allow for better, more separable, semantically distinct representations of objects at varying scales. The quality is demonstrated with varying metrics corresponding to unsupervised segmentation on the masks that are generated as a byproduct of this OCL pipeline.
[W1] The impact of the work seems limited. The ideas about multi-scale representation and fusion themselves are not novel (see for example FPN in object detection literature), but the implementation and application to this task are. However, the implementation neglects potentially more impactfully redesigns of the primary encoder-decoder pipeline or the slot attention mechanism itself. 

[W2] Additionally, there are no results for any downstream tasks. Thus, while interesting, it is hard to project the impact of the work beyond this niche.

Minor: The notation and its interaction with Figure 3 is unpleasant and difficult to follow. In particular, the differences between scale-variant, scale-invariant, and representation before inter-scale fusion are quite slight and seem slightly arbitrary. 

Minor: Algorithm 1 would fit in the main paper, and help add clarity in the flow.
Yes
No ethics review needed.
Overall the paper is good, but the results specially on COCO seems a bit incremental.
1) The overall intuition and direction of the paper is good and deal with important problems of Object-Centric Learning.
2) The multi-scale training makes a lot sense since dealing with objects is an important problem and generally has not been solved fully in the field.
3) The paper shows good analysis and shows object separability of VAE guidance in Fig3. Fig2 quantitative results also look good.
This paper addresses Object-Centric Learning (OCL), which aims to capture comprehensive object information by reconstructing inputs using intermediate representations from a Variational Autoencoder (VAE). The focus is on multi-scale training, acknowledging that objects may appear at various scales in images or videos due to changes in imaging distance or intrinsic size differences. The authors propose Multi-Scale Fusion (MSF) applied to VAE representations to guide OCL for both transformer-based approaches and state-of-the-art diffusion models. The method demonstrates promising performance on datasets such as COCO, ClevrTex, and VOC.
1) Results on real world datasets especially COCO in Table 1 are really incremental. It’s not really clear how much advantage is by adding MSF.
2) Analysis of varying object sizes can show results on scale understanding better than overall IoU improvement.
3) Is there any intuition as to why the value of n is 3? Can we do a similar experiment on OpenImages and see if this holds true across datasets? For Openimages, if it’s easier you can try using the smaller subset of open images curated in this paper [1].
4) Discussion on the area of unsupervised semantic segmentation and object detection using SSL methods should be added. Papers like [1,2,3] should be discussed. 
References:
1) Hyperbolic Contrastive Learning for Visual Representations beyond Objects CVPR2023
2) VideoCutLER
3) MOST: Multiple Object localization with Self-supervised Transformers for object discovery
Yes
No ethics review needed.
I am not familiar with this field, so please refer to the weakness
1. The paper is clear writing and easy to follow.
This paper addresses the lack of multi-scale object representation in VAE-guided OCL problems by constructing a multi-scale VAE model. This enables the VAE-generated results to represent multi-scale objects, thereby improving performance across various tasks.
1. I think the paper's novelty is very limited. Although I am not familiar with object-centric learning, I believe that constructing multi-scale VAE features has already been applied in many generative tasks[1, 2]. Therefore, the core innovation of this paper, in my opinion, does not warrant a standalone publication. Can the author tell me about the difference between MSF and other methods?

2. Since I am not familiar with this field, the Area Chair (AC) and the authors may disregard my opinion if it appears to be biased.

[1]Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction, arxiv2404.02905
[2]SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs, NeurIPS2023
Yes
No ethics review needed.
Can the proposed method be applied to state-of-the instance segmentation models, like MaskDINO, to improve their results (~50 mask AP) on MS-COCO for instance segmentation.
The MSF is straightforward and easy to understand. According to the experimental results, it works well and improves a strong basline model DINO.
OCL is an interesting and promising direction and this paper outperform previous OCL methods.
The method can be generalized to virous computer tasks and model to improve their representation of objects.
This paper is motivated by Object-Centric Learning (OCL) AND introduces a multi-scale fusion scheme to vanilla VAE and improves its representation of different scales of objects. The motivation is convincing, but the technical novelty is limited and multi-scale fusion is a widely used technique in many models and computer vision tasks. Though this paper proposes some specific design modules, like multi-scale features augmentation, they are straightforward and improvements are limited according to the ablation study.
Though the technical novelty is limited, this paper investigate an interesting view, OCL, to VAE, should be benefit the comunity.
According to Sec. 4.1, the improvements from MSF are limited, just 1-2 points in many metrics. 
The overall presentation is not satisfactory and difficult to understand for readers not familiar with OCL.
By processing the same image in different sizes, we obtain representations in multiple scales. And high quality object super-pixels in one scale can augment the low quaity super-pixels of the same object in other scales.
@inproceedings{
anonymous2024multiscale,
title={Multi-Scale Fusion for Object Representation},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=nobDw4d1k7},
note={under review}
}
Representing images or videos as object-level feature vectors, rather than pixel-level feature maps, facilitates advanced visual tasks. Object-Centric Learning (OCL) primarily achieves this by reconstructing the input under the guidance of Variational Autoencoder (VAE) intermediate representation to drive so-called $\textit{slots}$ to aggregate as much object information as possible. However, existing VAE guidance does not explicitly address that objects can vary in pixel sizes while models typically excel at specific pattern scales. We propose $\textit{Multi-Scale Fusion}$ (MSF) to enhance VAE guidance for OCL training. To ensure objects of all sizes fall within VAE's comfort zone, we adopt the $\textit{image pyramid}$, which produces intermediate representations at multiple scales; To foster scale-invariance/variance in object super-pixels, we devise $\textit{inter}$/$\textit{intra-scale fusion}$, which augments low-quality object super-pixels of one scale with corresponding high-quality super-pixels from another scale. On standard OCL benchmarks, our technique improves mainstream methods, including state-of-the-art diffusion-based ones. The source code is available in the supplemental material.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Object-Centric Learning (OCL) Variational Autoencoder (VAE) Multi-Scale Unsupervised Object Segmentation
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/3a7d0099d98226ba0b6cce27883e52f71340851d.pdf
unsupervised, self-supervised, semi-supervised, and supervised representation learning
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/79f3f50d1123deeb410622466a30888ff1a733f8.zip
Multi-Scale Fusion for Object Representation
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission