Internò, Christian, Geirhos, Robert, Olhofer, Markus, Liu, Sunny, Hammer, Barbara, Klindt, David (July 2025) AI-Generated Video Detection via Perceptual Straightening. arXiv. ISSN 2331-8422 (Submitted)
![[thumbnail of 10.48550.arXiv.2507.00583.pdf]](https://repository.cshl.edu/style/images/fileicons/application_pdf.png) |
PDF
10.48550.arXiv.2507.00583.pdf - Submitted Version Available under License Creative Commons Attribution Share Alike. Download (18MB) |
Abstract
The rapid advancement of generative AI enables highly realistic synthetic videos, posing significant challenges for content authentication and raising urgent concerns about misuse. Existing detection methods often struggle with generalization and capturing subtle temporal inconsistencies. We propose ReStraV(Representation Straightening Video), a novel approach to distinguish natural from AI-generated videos. Inspired by the "perceptual straightening" hypothesis -- which suggests real-world video trajectories become more straight in neural representation domain -- we analyze deviations from this expected geometric property. Using a pre-trained self-supervised vision transformer (DINOv2), we quantify the temporal curvature and stepwise distance in the model's representation domain. We aggregate statistics of these measures for each video and train a classifier. Our analysis shows that AI-generated videos exhibit significantly different curvature and distance patterns compared to real videos. A lightweight classifier achieves state-of-the-art detection performance (e.g., 97.17% accuracy and 98.63% AUROC on the VidProM benchmark), substantially outperforming existing image- and video-based methods. ReStraV is computationally efficient, it is offering a low-cost and effective detection solution. This work provides new insights into using neural representation geometry for AI-generated video detection.
| Item Type: | Paper |
|---|---|
| Subjects: | bioinformatics bioinformatics > computational biology > algorithms bioinformatics > computational biology |
| CSHL Authors: | |
| Communities: | CSHL labs > Klindt lab |
| SWORD Depositor: | CSHL Elements |
| Depositing User: | CSHL Elements |
| Date: | 1 July 2025 |
| Date Deposited: | 14 Jul 2025 18:04 |
| Last Modified: | 14 Jul 2025 18:04 |
| Related URLs: | |
| URI: | https://repository.cshl.edu/id/eprint/41902 |
Actions (login required)
 |
Administrator's edit/view item |