da/sec scientific talk on Biometrics

Topic: CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage

by Baptiste Chopin
D19/2.03a (also online via the corresponding BBB room), September 17, 2026 (Thursday), 12.00 noon

Keywords — Deepfakes, Benchmark, Surveillance, Videos

Abstract

„Due to rapid advances in Generative AI, commercial video generation tools can be used to produce fabricated surveillance footage that can fool both human viewers and automated synthetic video detectors. Since these tools are so widely accessible, a malicious user can create a harmful video clip at minimal cost. The production and dissemination of such videos in high-stakes settings, such as crime reporting and elections, can misdirect emergency response efforts or distort political discourse. Existing deepfake video datasets, used by the research community to develop deepfake detection algorithms, exhibit two limitations: (1) they emphasize benign web content rather than footage of possibly malicious activity, and (2) they rely on older or open-source generators that do not represent recent advances in generative systems. We assemble CCDF, a video deepfake dataset, to address both gaps. CCDF contains 1,840 videos (460 real and 1,380 generated) spanning 16 crime and accident categories, with generated content produced using three leading commercial systems: Grok Imagine, VEO 3.1, and Sora 2. We release two versions of the dataset: a cleaned version in which resolution, frame rate, duration, and bitrate are standardized between real and synthetic samples to prevent detectors from exploiting trivial cues, and an altered version simulating low-effort post-processing attacks. We evaluate CCDF with nine recent state-of-the-art detectors covering different detection approaches. Our results suggest that these approaches do not reliably distinguish CCDF’s generated videos from real ones, despite their strong reported performance on existing datasets. These results further confirm that existing datasets are not well-suited to evaluating certain threats.“