Logo image
FREQUENCY MASKING FOR UNIVERSAL DEEPFAKE DETECTION
Conference proceeding

FREQUENCY MASKING FOR UNIVERSAL DEEPFAKE DETECTION

Chandler Timm Doloriel, Ngai-Man Cheung and IEEE
Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998), pp.13466-13470
International Conference on Acoustics Speech and Signal Processing ICASSP
01/01/2024

Abstract

Acoustics Computer Science Computer Science, Artificial Intelligence Engineering Engineering, Electrical & Electronic Imaging Science & Photographic Technology Science & Technology Technology
We study universal deepfake detection. Our goal is to detect synthetic images from a range of generative AI approaches, particularly from emerging ones which are unseen during training of the deepfake detector. Universal deepfake detection requires outstanding generalization capability. Motivated by recently proposed masked image modeling which has demonstrated excellent generalization in self-supervised pre-training, we make the first attempt to explore masked image modeling for universal deepfake detection. We study spatial and frequency domain masking in training deepfake detectors. Based on empirical analysis, we propose a novel deepfake detector via frequency masking. Our focus on frequency domain is different from the majority, which primarily target spatial domain detection. Our comparative analyses reveal substantial performance gains over existing methods. Code and models are publicly available(1).

Metrics

1 Record Views

Details

Logo image