Source Cell-Phone Identification Using Genetic Algorithm Optimized Temporal Convolutional Network

doi:10.3778/j.issn.1002-8331.2008-0075

Abstract

Abstract: The speech based source cell-phone identification has been a hot topic in the field of multimedia forensics in recent years. Existing studies rarely consider environmental background noises, which is difficult to meet the needs of practical application scenarios in the judicial field. To this end, this paper proposes a genetic algorithm optimized temporal convolutional network（TCN） for source cell-phone identification. Firstly, the logarithmic Mel-filter bank coefficients are input to the TCN for learning deep speech features, based on which the low-dimensional deep feature（LDDF） is extracted by using the linear discriminant analysis. Then, the LDDF is input into a support vector machine for training and recognition. Particularly, to improve the whole recognition performance, the genetic algorithm is introduced and encoding scheme, fitness function, and genetic operations are successively developed to intelligently optimize the architecture of TCN. Finally, comparative experimental results show that the proposed method can automatically design the TCN architecture to maximize its performance as much as possible and further improves the recognition accuracy.

Key words: source cell-phone identification, temporal convolutional network, network architecture, genetic algorithm, intelligent optimization

摘要： 基于语音的手机来源识别已成为近年来多媒体取证领域中的一个研究热点。已有研究鲜有考虑环境背景噪声，难以满足司法领域实际应用场景的需求。提出一种遗传算法优化时间卷积网络的手机来源识别方法。基于对数域的Mel滤波器组系数特征，利用时间卷积网络进行深度语音特征学习，并利用线性判别分析提取低维深度特征，将低维深度特征输入到支持向量机中进行训练和识别。特别的，为了提高整体的识别性能，引入遗传算法，通过设计编码方式、适应度函数和遗传操作对时间卷积网络结构进行智能优化。对比实验结果表明，所提方法可对时间卷积网络结构进行自动设计，尽可能地发挥网络性能，从而进一步提升了识别准确率。

关键词: 手机来源识别, 时间卷积网络, 网络结构, 遗传算法, 智能优化

WU Qinfang, WU Zhangqian, SU Zhaopin, ZHANG Guofu. Source Cell-Phone Identification Using Genetic Algorithm Optimized Temporal Convolutional Network[J]. Computer Engineering and Applications, 2022, 58(3): 151-158.

武钦芳, 吴张倩, 苏兆品, 张国富. 遗传算法优化时间卷积网络的手机来源识别[J]. 计算机工程与应用, 2022, 58(3): 151-158.

References

[1] 贺前华，王志锋，RUDNICKY A I，等.基于改进PNCC特征和两步区分性训练的录音设备识别方法[J].电子学报，2014，42（1）：191-198.
HE Q H，WANG Z F，RUDNICKY A I，et al.A recording device identification algorithm based on improved PNCC feature and two-step discriminative training[J].Acta Electronica Sinica，2014，42（1）：191-198.
[2] 王华朋，姜囡，刘恩，等.法庭语音比对中话者自身变化性建模方法研究[J].计算机工程与应用，2019，55（8）：110-115.
WANG H P，JIANG N，LIU E，et al.Study on modeling method of inter-speaker variability in forensic voice comparison[J].Computer Engineering and Applications，2019，55（8）：110-115.
[3] ZAKARIAH M，KHAN M K，MALIK H.Digital multimedia audio forensics：past，present and future[J].Multimedia Tools and Applications，2018，77（1）：1009-1040.
[4] HANILCI C，KINNUNEN T.Source cell-phone recognition from recorded speech using non-speech segments[J].Digital Signal Processing，2014，35：75-85.
[5] AGGARWAL R，SINGH S，ROUL A K，et al.Cellphone identification using noise estimates from recorded audio[C]//Proceedings of the International Conference on Communication and Signal Processing，Melmaruvathur，April 3-5，2014.Piscataway：IEEE，2014：1218-1222.
[6] QI S，HUANG Z，LI Y，et al.Audio recording device identification based on deep learning[C]//Proceedings of the IEEE International Conference on Signal and Image Processing，Beijing，Aug 13-15，2016.Piscataway：IEEE，2016：426-431.
[7] 裴安山，王让定，严迪群.基于设备本底噪声频谱特征的手机来源识别[J].电信科学，2017，33（1）：85-94.
PEI A S，WANG R D，YAN D Q.Cell-phone origin identification based on spectral features of device self-noise[J].Telecommunications Science，2017，33（1）：85-94.
[8] 裴安山，王让定，严迪群.基于语音静音段特征的手机来源识别方法[J].电信科学，2017，33（7）：103-111.
PEI A S，WANG R D，YAN D Q.Source cell-phone identification from recorded speech using non-speech segments[J].Telecommunications Science，2017，33（7）：103-111.
[9] 裴安山，王让定，严迪群.基于语音频谱融合特征的手机来源识别[J].计算机应用，2018，38（3）：884-890.
PEI A S，WANG R D，YAN D Q.Cell-phone source identification based on spectral fusion features of recorded speech[J].Journal of Computer Applications，2018，38（3）：884-890.
[10] LUO D，KORUS P，HUANG J.Band energy difference for source attribution in audio forensics[J].IEEE Transactions on Information Forensics and Security，2018，13（9）：2179-2189.
[11] QIN T，WANG R，YAN D，et al.Source cell-phone identification in the presence of additive noise from CQT domain[J].Information，2018，9（8）.
[12] 秦天芸，王让定，裴安山.基于线性预测梅尔频率倒谱系数的设备来源识别[J].数据通信，2018（4）：20-25.
QIN T Y，WANG R D，PEI A S.Cell-phone source identification based on linear prediction Mel frequency cepstral coeffificient[J].Data Communication，2018（4）：20-25.
[13] JIN C，WANG R，YAN D.Source smartphone identification by exploiting encoding characteristics of recorded speech[J].Digital Investigation，2019，29：129-146.
[14] BALDINI G，AMERINI I.Smartphones identification through the built-in microphones with convolutional neural network[J].IEEE Access，2019，7：158685-158696.
[15] BAI S，KOLTER J Z，KOLTUN V.An empirical evaluation of generic convolutional and recurrent networks for sequence modeling[EB/OL].（2018-03-04）[2020-08-06].https：//arxiv.org/pdf/1803.01271.pdf.
[16] ABBASIAN H，NASERSHARIF B，AKBARI A，et al.Optimized linear discriminant analysis for extracting robust speech features[C]//Proceedings of the 3rd International Symposium on Communications，Control and Signal Processing，St Julians，March 12-14，2008.Piscataway：IEEE，2008：819-824.
[17] CHANG C C，LIN C J.LIBSVM：a library for support vector machines[J].ACM Transactions on Intelligent Systems and Technology，2011，2（3）.
[18] LIBSVM tools[EB/OL].（2019-12-07）[2020-08-06].https：//www.csie.ntu.edu.tw/~cjlin/libsvmtools/.
[19] GOLDBERG D E.Genetic algorithms in search，optimization and machine learning[M].Boston：Addison-Wesley，1989.
[20] MCFEE B，RAFFEL C，LIANG D，et al.Librosa：audio and music signal analysis in Python[C]//Proceedings of the 14th Python in Science Conference，Austin，July 11-17，2015.Austin：SciPy Organizers，2015：18-25.
[21] ABDEL-HAMID O，MOHAMED A，JIANG H，et al.Convolutional neural networks for speech recognition[J].IEEE/ACM Transactions on Audio，Speech，and Language Processing，2014，22（10）：1533-1545.
[22] IOFFE S，SZEGEDY C.Batch normalization：accelerating deep network training by reducing internal covariate shift[C]//Proceedings of the 32nd International Conference on Machine Learning，Lille，July 6-11，2015.Lille：JMLR.org，2015：448-456.
[23] NWANKPA C，IIOMAH W，GACHAGAN A，et al.Activation functions：comparison of trends in practice and research for deep learning[EB/OL].（2018-11-08）[2020-08-06].https：//arxiv.org/pdf/1811.03378v1.pdf.
[24] DOGO E M，AFOLABI O J，NWULU N I，et al.A comparative analysis of gradient descent-based optimization algorithms on convolutional neural networks[C]//Proceedings of the International Conference on Computational Techniques，Electronics and Mechanical Systems，Belgaum，Dec 21-22，2018.Piscataway：IEEE，2018：92-99.
[25] 林景栋，吴欣怡，柴毅，等.卷积神经网络结构优化综述[J].自动化学报，2020，46（1）：24-37.
LIN J D，WU X Y，CHAI Y，et al.Structure optimization of convolutional neural networks：a survey[J].Acta Automatica Sinica，2020，46（1）：24-37.
[26] SUN Y，XUE B，ZHANG M，et al.Completely automated CNN architecture design based on blocks[J].IEEE Transactions on Neural Networks and Learning Systems，2020，31（4）：1242-1254.
[27] DROSTE S，JANSEN T，WEGENER I.On the analysis of the （1+1） evolutionary algorithm[J].Theoretical Computer Science，2002，276（1/2）：51-81.
[28] VAN DER MAATEN L，HINTON G.Visualizing data using t-SNE[J].Journal of Machine Learning Research，2008，9：2579-2605.
[29] FAWCETT T.An introduction to ROC analysis[J].Pattern Recognition Letters，2006，27（8）：861-874.