Computer Engineering and Applications ›› 2023, Vol. 59 ›› Issue (22): 276-283.DOI: 10.3778/j.issn.1002-8331.2206-0510

• Network, Communication and Security • Previous Articles     Next Articles

Deepfake Video Detection Method Improved by GRU and Involution

LIU Yalin, LU Tianliang   

  1. College of Information and Cyber Security, People’s Public Security University of China, Beijing 100038, China
  • Online:2023-11-15 Published:2023-11-15

GRU和Involution改进的深度伪造视频检测方法

刘亚琳,芦天亮   

  1. 中国人民公安大学 信息网络安全学院,北京 100038

Abstract: In recent years, the wide spread of deepfake video on the network has caused a negative impact. In order to solve the problems of low accuracy of existing detection models and insufficient and comprehensive information extraction, an improved deepfake video detection method based on gated recurrent unit(GRU) and Involution is proposed. Firstly, a feature extraction network is constructed based on Involution operator to extract global feature information, which enhances the spatial modeling ability of face image from spatial and channel information. Then, the temporal features are extracted through the location and inter-frame information of the main capsule layer and GRU concern features. Finally, focalloss is used as the loss function to balance the samples in the training model phase. The method is tested in Deepfakes, FaceSwap and Celeb-DF datasets, and the experimental results show that the method is better than the mainstream detection methods. The improved comparative experiments further prove the effectiveness of the detection method.

Key words: deepfake, gated recurrent unit(GRU), Involution, capsule network, focalloss

摘要: 近年来深度伪造视频在网络上广泛传播,造成了负面影响。针对现有检测模型准确率低和信息提取不够充分和全面的问题,提出了一种GRU(gated recurrent unit)和Involution改进的深度伪造视频检测方法。首先使用VGG19作为主干网络提取空间特征,并将Involution算子嵌入主干网络,从空间和通道信息两方面加强了人脸图像的空间建模能力。然后通过主胶囊层关注特征的位置信息和使用GRU提取帧间的时序特征。最后在训练模型阶段使用focalloss作为损失函数来平衡样本。在Deepfakes、FaceSwap和Celeb-DF数据集中进行测试,实验结果表明该方法优于主流检测方法,改进对比实验进一步证明了检测方法的有效性。

关键词: 深度伪造, 门控循环单元(GRU), Involution, 胶囊网络, focalloss