Can I read Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes on EtoBox?

Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes by Trinh, Loc; Tsang, Michael; Rambhatla, Sirisha; Liu, Yan is a scholarly article available to read on EtoBox.

What is Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes about?

In this paper we propose a novel human-centered approach for detecting forgery in face images, using dynamic prototypes as a form of visual explanations. Currently, most state-of-the-art deepfake detections are based on black-box models that process videos frame-by-frame for inference, and few closely examine their temporal inconsistencies. However, the existence of such temporal artifacts within deepfake videos is key in detecting and explaining deepfakes to a supervising human. To this end, we propose Dynamic Prototype Network (DPNet) -- an interpretable and effective solution that utilizes dynamic representations (i.e., prototypes) to explain deepfake temporal artifacts. Extensive experimental results show that DPNet achieves competitive predictive performance, even on unseen testing datasets such as Google's DeepFakeDetection, DeeperForensics, and Celeb-DF, while providing easy referential explanations of deepfake dynamics. On top of DPNet's prototypical framework, we further formulate temporal logic specifications based on these dynamics to check our model's compliance to desired temporal behaviors, hence providing trustworthiness for such critical detection systems.

Author

Trinh, Loc; Tsang, Michael; Rambhatla, Sirisha; Liu, Yan

Published

2020

Language

EN