Dual-Path Network Model Fusing Frequency-Domain Features to Diagnose COVID-19

doi:10.3778/j.issn.1002-8331.2111-0345

Abstract

Abstract: CT examination plays an important role in the diagnosis of COVID-19. In order to obtain more characteristic information about COVID-19 from the limited CT chest image set and establish a more sensitive and general diagnostic model, this paper proposes a dual-path network model（Dp-Net） that integrates CT image frequency domain features. The main part of this model adopts ResNet network model. The training process of convolutional neural network is divided into two parts：one is to extract the spatial domain features of CT images, the other is to extract the frequency domain features through Fourier transform, and then the results of the two parts are fused with a certain weight, and then one more time feature extraction is carried out by Layer4 module. Finally, compared with traditional CNN models such as ResNet and VGG, as well as some improved CNN models such as Self-Trans and LA-DNN, on the open COVID-19 CT data set, and compared with fusion schemes with different weights. Experimental results show that the Dp-Net model achieves better results on various evaluation indexes.

Key words: COVID-19, CT images, frequency domain, feature fusion, convolutional neural network

摘要： CT检查在新冠肺炎诊断中起着重要作用，为了能够在有限的CT胸部图像集中获得更多有关新冠肺炎的特征信息、建立更加敏感通用的诊断模型，提出了融合CT图像频域特征的双路网络模型（Dp-Net），该模型主干部分采用ResNet网络模型，并将卷积神经网络的训练过程分为两个部分，一部分提取CT图像空间域的特征，另一部分通过傅里叶变换提取频率域上的特征，将两者训练的结果按照一定的权重进行融合，融合后再由Layer4模块进行一次特征提取。在公开的COVID-CT数据集上与ResNet、VGG等传统的CNN模型进行了比较，也与Self-Trans和LA-DNN等一些改进的CNN模型进行了比较，并对不同权重的融合方案进行了比较，实验结果表明提出的Dp-Net模型在各种评价指标上取得了更好的结果。

关键词: 新冠肺炎, CT图像, 频率域, 特征融合, 卷积神经网络

YANG Yuhang, LIN Min, WANG Changying, ZHONG Yiwen. Dual-Path Network Model Fusing Frequency-Domain Features to Diagnose COVID-19[J]. Computer Engineering and Applications, 2023, 59(5): 321-327.

杨宇航, 林敏, 王长缨, 钟一文. 融合频率域特征的双路网络模型诊断新冠肺炎[J]. 计算机工程与应用, 2023, 59(5): 321-327.

References

[1] 赵思敏，陈正光.新型冠状病毒肺炎的研究进展[J].中国中西医结合影像学杂志，2021，19（2）：103-107.
ZHAO S M，CHEN Z G.Research progress of COVID-19[J].Chinese Imaging Journal of Integrated Traditional and Western Medicine，2021，19（2）：103-107.
[2] 周子棋，康莉，黄建军.多站点新冠肺炎肺部CT图像的三维深度卷积分割[J].信号处理，2021，37（11）：2178-2184.
ZHOU Z Q，KANG L，HUANG J J.3D CNN segmentation of multi-site lung CT COVID-19 lesion[J].Journal of Signal Processing，2021，37（11）：2178-2184.
[3] HE X H，YANG X Y，ZHANG S H，et al.Sample-efficient deep learning for COVID-19 diagnosis based on CT scans[J].medRxiv，2020.doi：https：//doi.org/10.1101/2020.04.13.
20063941.
[4] LIU B，GAO X X，HE M S，et al.Online COVID-19 diagnosis with chest CT images：lesion-attention deep neural networks[J].medRxiv，2020.doi：https：//doi.org/10.1101/
2020.05.11.20097907.
[5] SONG Y，ZHENG S，LI L，et al.Deep learning enables accurate diagnosis of novel coronavirus（COVID-19） with CT images[J].IEEE/ACM Transactions on Computational Biology and Bioinformatics，2021，18（6）：2775-2780.
[6] RAHIMZADEH M，ATTAR A，SAKHAEI S M.A fully automated deep learning-based network for detecting COVID-19 from a new and large lung CT scan dataset[J].Biomedical Signal Processing and Control，2021，68（1）：102588.
[7] XU X，JIANG X，MA C，et al.Deep learning system to screen coronavirus disease，2019 pneumonia[J].arXiv：2002. 09334，2020.
[8] WANG B，JIN S，YAN Q，et al.AI-assisted CT imaging analysis for COVID-19 screening：building and deploying a medical AI system[J].Applied Soft Computing，2020：106897.
[9] 吴辰文，梁雨欣，田鸿雁.改进卷积神经网络的COVID-19 CT影像分类方法研究[J].计算机工程与应用，2022，58（2）：225-234.
WU C W，LIANG Y X，TIAN H Y.Research on COVID-19 CT image classification method based on improved convolutional neural network[J].Computer Engineering and Applications，2022，58（2）：225-234.
[10] 胡屹杉，秦品乐，曾建潮，等.结合分段频域和局部注意力的超声甲状腺分割[J].中国图象图形学报，2020，25（10）：2195-2205.
HU Y S，QIN P L，ZENG J C，et al.Ultrasound thyroid segmentation based on segmented frequency domain and local attention[J].Journal of Image and Graphics，2020，25（10）：2195-2205.
[11] HE K M，ZHANG X Y，REN S Q，et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：770-778.
[12] YANG X Y，HE X H，ZHAO J Y，et al.COVID-CT-Dataset：a CT scan dataset about COVID-19[J].arXiv：2003.13865，2020.
[13] KRIZHEVSKY A，SUTSKEVER I，HINTON G E.ImageNet classification with deep convolutional neural networks[J].Communications of the ACM，2017，60（6）：84-90.
[14] SIMONYAN K，ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv：1409.1556，2014.
[15] HUANG G，LIU Z，LAURENS V，et al.Densely connected convolutional networks[J].IEEE Computer Society，2016.
[16] SELVARAJU R R，COGSWELL M，DAS A，et al.Grad-CAM：visual explanations from deep networks via gradient-based localization[J].International Journal of Computer Vision，2020，128（2）：336-359.
[17] EDUARDO S，PLAMEN A，BIASO S，et al.SARS-CoV-2 CT-scan dataset：a large dataset of real patients CT scans for SARS-CoV-2 identification[J].medRxiv，2020.doi：https：//doi.org/10.1101/2020.04.24.20078584.