通过CNN集成进行视频人脸操纵检测

qqphysics69770 21 0 .pdf 2021-01-22 14:01:04

在过去的几年中,视频中面部操纵的几种技术已经成功开发并提供给大众(即FaceSwap,deepfake等)。这些方法使任何人都可以轻松地编辑视频序列中的人脸,并获得难以置信的逼真的结果和很少的精力。..

Video Face Manipulation Detection Through Ensemble of CNNs

In the last few years, several techniques for facial manipulation in videos have been successfully developed and made available to the masses (i.e., FaceSwap, deepfake, etc.). These methods enable anyone to easily edit faces in video sequences with incredibly realistic results and a very little effort.Despite the usefulness of these tools in many fields, if used maliciously, they can have a significantly bad impact on society (e.g., fake news spreading, cyber bullying through fake revenge porn). The ability of objectively detecting whether a face has been manipulated in a video sequence is then a task of utmost importance. In this paper, we tackle the problem of face manipulation detection in video sequences targeting modern facial manipulation techniques. In particular, we study the ensembling of different trained Convolutional Neural Network (CNN) models. In the proposed solution, different models are obtained starting from a base network (i.e., EfficientNetB4) making use of two different concepts: (i) attention layers; (ii) siamese training. We show that combining these networks leads to promising face manipulation detection results on two publicly available datasets with more than 119000 videos.

用户评论
请输入评论内容
评分:
暂无评论