Consistency Verification for Detecting AI-Generated Images
AI-generated image detection;Generative models;Diffusion models;GAN
Yes
No ethics review needed.
As shown in Table 6, it appears that ConV is sensitive to the initialization function. ConV instantiated by CLIP performs much worse than DinoV2. Is there an approach to overcome this limitation?
- The underlying mathematical intuition of this paper is well-presented. 
- The method looks novel to me and its effectiveness has been supported by a collection of experiments.
This paper presents a framework, termed Consistency Verification (ConV), aimed at detecting AI-generated images. Different from traditional binary classifiers that require extensive collections of both natural and AI-generated images, ConV operates solely on the distribution of natural images. The authors introduce two functions whose outputs are consistent for natural images but highly different for AI-generated images.
- **Theoretical Limitation**: Although the orthogonality principle is empirically validated, a formal proof of the convergence of ConV’s generalization risk is not provided, which could strengthen the theoretical grounding.

- **Clarity in Wording**: In line 135, the phrase, *"..., humans know that if a natural image $x_n$ captures the same content as $x_g$ , they are distinguishable in certain ways,"* could cause confusion. The authors might consider revising this to *"...even if a natural image $x_n$ captures similar content to $x_g$"* to clarify that subtle differences still make AI-generated and natural images distinguishable.
Yes
No ethics review needed.
1. *Limited Theoretical Justification:** While the orthogonality principle provides some intuition, a more rigorous theoretical analysis of why and how the method works would strengthen the paper. For instance, There is no explanation for why the augmentations during DinoV2 training are orthogonal to its standard output? Moreover, the theoretical analysis in the paper does not provide any guidance for the choice of augmentations.
2. **Lack of Novelty:** The method proposed in this paper is based on Baseline RIGID, but it only replaces Gaussian noise with training enhancements, without much insightful design. In addition, it does not explain why these enhancements are better than Gaussian noise.
3. **Limited Implementation Details:** The paper does not give specific details of the data augmentation used, including the parameters of the data augmentation used, and whether a single augmentation or a combination of multiple augmentations is used.
4. **Single Backbone Model:** The paper only tested on DinoV2 and not on more (self-supervised) models. Does this mean that the scope of application of this method is limited?
Training-Free**: It eliminates the need for large datasets of generated images and the computational cost associated with training a classifier.
Theoretical support: The method's validity is explained the orthogonality principle to some extend.**
This paper presents a AI-generated images detection method called Consistency Verification (ConV). Unlike traditional approaches that rely on binary classifiers trained on both natural and AI-generated images, ConV is training-free. The key innovation lies in introducing two functions that remain consistent for natural images but show inconsistency for AI-generated images.
See questions.
Yes
No ethics review needed.
See weakness for the main issues. 

1) I did not quite understand of the data processing procedure of the GenImage dataset on Page 15. I feel like the authors cropped the AI-generated images in 224 by 224 dimensions, but treated ImageNet data differently by resizing first, and then cropping it to 224 by 224 size.
Did I understand it correctly? If it is, why the processing method is different in AI-generated and real images?

2) I am curious how AEROBLADE will perform in the GenImage dataset. (The table has typos by the way)

3) While this is minor, I would like to see the runtime analysis of the proposed method, given that the paper utilizes lots of ensembles.
1) I like the setting where the pre-trained foundation model is used for the prediction instead of exhausting training on AI-generated or real data.
2) Experiment on SORA benchmark is also interesting.
This paper proposes a consistency verification approach that does not require AI-generated images for training. The key component of the design is two functions: the representation function f1 based on the self-supervised pre-trained model (e.g., Dinov2). The transformation function h is also based on the self-supervised model's data augmentation. The author hypothesizes that the deviation after the transformation function in the representation space will be smaller in the real image, and larger in the AI-generated images.
1) I feel the novelty of the paper is weak. The paper borrows lots of ideas from the RIGID, the baseline paper. RIGID measures cosine similarity between the dinov2 representation of the original image and the dinov2 representation of the deviated image through Gaussian Noise Augmentation. This paper does the same except changing cosine similarity to l2 distance, and Gaussian augmentation to training augmentations (e.g. Gaussian Blur, Colorjitter). Hence, I feel like this paper is just an ablation study of the RIGID paper, and the contributions should go to the original paper (e.g. applying Dinov2, and proposing a similar consistency function).

2) Experiment results also feel weak. The proposed method does not outperform RIGID in all cases. Aligned to 1), I feel like this paper should at least outperform RIGID in all experiments, not only on the average but also in all AI-generated data. Maybe more deeper analysis will be helpful.

3) Section 2 is hard to read. 2.1~2.3 seems to overexplain general ideas of manifold hypothesis, which is not new. In my opinion, this is just a longer extraction of "This model is trained on the real data so it will show robust output on the real data when the training data augmentation is applied". The final consistency term form has been applied to various binary classification tasks ([1],[2]). Maybe a deeper explanation of why this explanation is necessary will be helpful.

4) The experiment results of RIGID are not the same, but deteriorated from the original paper, especially in the ImageNet dataset. I wonder why such a discrepancy occurs, given that the performance gap between the proposed method and RIGID is not so large. This is more puzzling since the performance of RIGID reported in this paper should be improved by using larger $n=20$. I hope the elaboration on this result will be beneficial to resolve my concerns.

Overall, I find the paper's novelty weak since RIGID is also based on the distance between the original dinov2 representation and the dinov2 representation of the perturbed data, given that RIGID is the main baseline of this paper.

[1]  Likelihood Ratios for Out-of-Distribution Detection, NIPS 2019

[2] Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encoder, NeurIPS 2020
@inproceedings{
anonymous2024consistency,
title={Consistency Verification for Detecting {AI}-Generated Images},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=PSQuy9sjQ8},
note={under review}
}
With the rapid development of generative models, AI-generated images have sparked significant concerns regarding their potential misuse for malicious purposes, highlighting the urgent need for AI-generated image detection. Current methods primarily focus on training a binary classifier to detect generated images. However, the efficacy of these methods is critically dependent on the quantity and quality of the collected AI-generated images. More importantly, they suffer from a generalization challenge: \emph{the literature lacks sufficient exploration of whether a binary classifier trained on images from a specific diffusion model can effectively generalize to images generated by other models.} In this work, we propose a novel framework termed \textbf{con}sistency \textbf{v}erification (ConV) for AI-generated image detection, providing a new approach that detects without requiring AI-generated images. In particular, we introduce two functions and establish a principle for designing them so that their outputs remain consistent for natural images but exhibit signiﬁcant inconsistency for AI-generated images. Our principle shows that gradients of these two functions need to lie within two mutually orthogonal subspaces. This enables a training-free detection approach: an image is identified as AI-generated if transformation along its data manifold results in a substantial change in the loss value of a self-supervised model pre-trained on natural images. This detection framework leads to the unique advantage of ConV over existing methods: \emph{ConV identifies AI-generated images by fitting the distribution of natural images rather than that of AI-generated images.} Extensive experiments across various benchmarks validate the effectiveness of the proposed ConV.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
AI-generated image detection Generative models Diffusion models GAN
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/9e47238de6ae7068667a8944eff7cc2c340b69bc.pdf
generative models
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Consistency Verification for Detecting AI-Generated Images
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission