Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Fake or JPEG? Revealing Common Biases in Generated Image Detection Datasets
(Submitted on 26 Mar 2024 (v1), last revised 28 Mar 2024 (this version, v2))
Abstract: The widespread adoption of generative image models has highlighted the urgent need to detect artificial content, which is a crucial step in combating widespread manipulation and misinformation. Consequently, numerous detectors and associated datasets have emerged. However, many of these datasets inadvertently introduce undesirable biases, thereby impacting the effectiveness and evaluation of detectors. In this paper, we emphasize that many datasets for AI-generated image detection contain biases related to JPEG compression and image size. Using the GenImage dataset, we demonstrate that detectors indeed learn from these undesired factors. Furthermore, we show that removing the named biases substantially increases robustness to JPEG compression and significantly alters the cross-generator performance of evaluated detectors. Specifically, it leads to more than 11 percentage points increase in cross-generator performance for ResNet50 and Swin-T detectors on the GenImage dataset, achieving state-of-the-art results.
We provide the dataset and source codes of this paper on the anonymous website: this https URL
Submission history
From: Patrick Grommelt [view email][v1] Tue, 26 Mar 2024 11:39:00 GMT (28601kb,D)
[v2] Thu, 28 Mar 2024 15:24:16 GMT (14301kb,D)
Link back to: arXiv, form interface, contact.