Analyzing Deep Learning Models’ Generalization Ability Under Different Augmentations on Deepfake Datasets

Huseynli I., VARLI S.

6th International Conference on Computer Science and Engineering, UBMK 2021, Ankara, Türkiye, 15 - 17 Eylül 2021, ss.694-698, (Tam Metin Bildiri) identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/ubmk52708.2021.9558927
  • Basıldığı Şehir: Ankara
  • Basıldığı Ülke: Türkiye
  • Sayfa Sayıları: ss.694-698
  • Anahtar Kelimeler: Deepfake, Dfdc, Digital video forensics, Face manipulation
  • Yıldız Teknik Üniversitesi Adresli: Evet

Özet

Deepfakes allow users to manipulate the identity of a person in a video or an image. Improvements on GAN-based techniques also generate more realistic and hard to detect fake faces. This threatens individuals and decreases trust in social media platforms. In this work, our goal is to report eight different models’ learning ability on, by far, the largest fake face dataset - DFDC. The models’ generalization ability was tested on the DFDC test set and Celeb-DF-v2 dataset. Effect of the various cut-out like augmentations to the learning was also reported.