Towards Understanding Perceptual Differences between Genuine and Face-Swapped Videos

要旨

In this paper, we report on perceptual experiments indicating that there are distinct and quantitatively measurable differences in the way we visually perceive genuine versus face-swapped videos. Recent progress in deep learning has made face-swapping techniques a powerful tool for creative purposes, but also a means for unethical forgeries. Currently, it remains unclear why people are misled, and which indicators they use to recognize potential manipulations. Here, we conduct three perceptual experiments focusing on a wide range of aspects: the conspicuousness of artifacts, the viewing behavior using eye tracking, the recognition accuracy for different video lengths, and the assessment of emotions. Our experiments show that responses differ distinctly when watching manipulated as opposed to original faces, from which we derive perceptual cues to recognize face swaps. By investigating physiologically measurable signals, our findings yield valuable insights that may also be useful for advanced algorithmic detection.

著者
Leslie Woehler
TU Braunschweig, Braunschweig, Germany
Martin Zembaty
TU Braunschweig, Braunschweig, Germany
Susana Castillo
TU Braunschweig, Braunschweig, Germany
Marcus Magnor
Institut für Computergraphik, Braunschweig, Germany
DOI

10.1145/3411764.3445627

論文URL

https://doi.org/10.1145/3411764.3445627

動画

会議: CHI 2021

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2021.acm.org/)

セッション: Human, ML & AI

[A] Paper Room 14, 2021-05-10 17:00:00~2021-05-10 19:00:00 / [B] Paper Room 14, 2021-05-11 01:00:00~2021-05-11 03:00:00 / [C] Paper Room 14, 2021-05-11 09:00:00~2021-05-11 11:00:00
Paper Room 14
13 件の発表
2021-05-10 17:00:00
2021-05-10 19:00:00
日本語まとめ
読み込み中…