HALO: Human-Aligned End-to-end Image Retargeting with Layered Transformations
Image Retargeting;Image Transformation;Image Editing
Yes
No ethics review needed.
See above.
Nil
The work uses saliency to achieve image retargeting in a learnable setting. The results are shown to be SOTA through an user study.
- The work relies heavily on a saliency detector - MDSAM, which is a challenge. Having the main task of retargeting rely on a pre-trained saliency detection network is a downer. 

- RetargetMe dataset is a standard one. However, the images are very simple and have distinct objects. The proposed work will fail when there are complex scenes with nonsalient objects. 

- Using saliency for retargeting has been explored extensively. There is hardly any novelty or contribution in this work.
Yes
No ethics review needed.
1) Why does GPNN outperform on the perceptual metric MUSIQ despite the provided visuals clearly showing that the proposed method delivers superior results?

2) How sensitive is the proposed approach to suboptimal inpainting results?

3) Why are the visual and quantitative results nearly identical when using either augmentation or the LPIPS loss? Does the model trained with the LPIPS loss not incorporate the augmentation method?
1) The authors address an interesting image rescaling problem and achieve visually impressive results compared to previous methods.

2) Their proposed multi-flow network for estimating transformations intuitively utilizes both the original undistorted image and a naively rescaled version to the target aspect ratio.

3) The proposed augmentation technique is logical and straightforward allowing to utilize DreamSim as loss function.
The authors introduce  a novel image retargeting method that leverages a layer decomposition approach to distinguish between salient and non-salient regions of an image. By applying distinct warping fields to these separate layers, the method minimizes overall distortion during aspect ratio changes. Additionally, the authors present a novel structure-prone perceptual loss, based on DreamSim, which evaluates structural similarity between input and output images.
1) The overall contribution of the method appears somewhat limited, as the primary innovation lies in the augmentation technique that enables the use of the DreamSim loss. Meanwhile, the layer decomposition and inpainting modules are employed in a plug-and-play manner without addressing their sensitivity or taking further steps to reduce reliance on off-the-shelf methods.

2) The quantitative evaluation is somewhat limited; incorporating additional no-reference perceptual image metrics, both traditional and learning-based, would strengthen the paper's claims. 

3) The writing quality and overall presentation should be enhanced to better reflect the promise of the proposed method's results.

4) The related work section requires improvement, particularly in highlighting the shortcomings of prior approaches and demonstrating how the proposed method overcomes the challenges outlined in the introduction.
Yes
No ethics review needed.
1. What image resolutions can the proposed method accommodate, and what is the processing time like?
2. What is the key to the proposed method's performance being superior to that of the comparison methods?
1. This paper proposes a end-to-end learnable image retargeting framework and the results are impressive.
2. This paper is well-written, showcasing a clear and coherent structure that effectively guides the reader through its main arguments and findings.
This paper presents an end-to-end trainable approach for image retargeting. The authors introduce a novel layered transformation to learn two warping fields utilizing a pre-defined saliency map and inpainting model. Additionally, they develop a tailored perceptual structural similarity loss for model training. Quantitative results and user studies showcase the method's effectiveness.
1. The performance of the proposed approach is fundamentally dependent on the choice of the saliency model and the image inpainting model utilized. The selected saliency model plays a crucial role in accurately identifying and highlighting the most important regions of the image. Meanwhile, the image inpainting model contributes significantly to the quality of the restored content. Together, these models work in tandem to optimize the overall results, making their selection a critical factor in achieving superior performance.
2. Although the paper offers a well-structured and clear introduction to the methodological process, guiding readers through the steps and techniques employed, it falls short in addressing the underlying principles that inform these methods.
The paper proposes a novel approach that achieves content- and structure-aware image retargeting
@inproceedings{
anonymous2024halo,
title={{HALO}: Human-Aligned End-to-end Image Retargeting with Layered Transformations},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=pfXVid1p1d},
note={under review}
}
Image retargeting aims to change the aspect-ratio of an image while maintaining its content and structure with less visual artifacts. 
Existing methods still generate many artifacts or lose a lot of original content or structure.  To address this, we introduce HALO, an end-to-end trainable solution for image retargeting. 
The core idea of HALO is to warp the input image to target resolution. 
Since humans are more sensitive to distortions in salient areas than non-salient areas of an image, HALO decomposes the input image into salient/non-salient layers and applies different wrapping fields to different layers. To further minimize the structure distortion in the output images, we propose perceptual structure similarity loss which measures the structure similarity between input and output images and aligns with human perception. Both quantitative results and a user study on the RetargetMe dataset show that our algorithm achieves SOTA. 
Especially, our method increases human preference by 13.21% compared with the second best method.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Image Retargeting Image Transformation Image Editing
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/1c412426c9688577c75167e2f8a682fcc524d370.pdf
applications to computer vision, audio, language, and other modalities
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/0f2d57d2249ca410930c4403874ac200f4ee0483.pdf
HALO: Human-Aligned End-to-end Image Retargeting with Layered Transformations
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission