Comparative research on fusion methods for multi-modal face recognition

doi:10.3778/j.issn.1002-8331.2009.19.047

Computer Engineering and Applications ›› 2009, Vol. 45 ›› Issue (19): 153-156.DOI: 10.3778/j.issn.1002-8331.2009.19.047

• 图形、图像、模式识别 • Previous Articles Next Articles

Comparative research on fusion methods for multi-modal face recognition

YE Jian-hua,LIU Zheng-guang

School of Electrical Engineering & Automation，Tianjin University，Tianjin 300072，China

Received:2008-04-16 Revised:2008-07-25 Online:2009-07-01 Published:2009-07-01
Contact: YE Jian-hua

多模态人脸识别融合方法比较研究

叶剑华,刘正光

天津大学电气与自动化工程学院，天津 300072

通讯作者: 叶剑华

Abstract

Abstract: Five fusion methods at match score level have been compared for multi-modal face recognition.Firstly Local Binary Pattern（LBP） descriptor is used to extract the LBP Histogram Sequence（LBPHS） from greyscale and depth face images.Then the corresponding linear subspaces are constructed by Fisherfaces respectively.The cosine similarity is adopted to compute the match scores of projected vectors.Then five methods are utilized to fuse match scores.The experimental results on FRGC database indicate that the recognition performance of all fusion methods except min-score is better than that of unimodal ones.

Key words: Local Binary Pattern（LBP）, Fisherfaces, multi-modal face recognition, fusion

摘要： 比较研究了多模态人脸识别中的5种匹配得分级融合方法。首先用局部二值模式（Local Binary Pattern，LBP）算子分别提取人脸灰度图像和深度图像的区域LBP直方图序列（LBP Histogram Sequence，LBPHS），采用Fisherfaces分别构建相应的线性子空间，用余弦相似度计算投影向量的匹配得分，再采用5种方法对匹配得分进行融合。在FRGC数据库上的实验结果表明，除最小匹配得分外，其他融合方法的识别性能都要优于单一模态的方法。

关键词: 局部二值模式, Fisherfaces, 多模态人脸识别, 融合

YE Jian-hua,LIU Zheng-guang. Comparative research on fusion methods for multi-modal face recognition[J]. Computer Engineering and Applications, 2009, 45(19): 153-156.

叶剑华,刘正光. 多模态人脸识别融合方法比较研究[J]. 计算机工程与应用, 2009, 45(19): 153-156.

[1]	LU Lixia, ZOU Junzhong, GUO Yucheng, ZHANG Jian, WANG Bei. Prediction of Knee Injury Based on Multimodal Fusion [J]. Computer Engineering and Applications, 2021, 57(9): 225-232.
[2]	WANG Bing, LE Hongxia, LI Wenjing, ZHANG Menghan. Mask Detection Algorithm Based on Improved YOLO Lightweight Network [J]. Computer Engineering and Applications, 2021, 57(8): 62-69.
[3]	ZHANG Yue, HUANG Yourui, LIU Pengkun. Research on Multi-resolution Human Pose Estimation with Attention Mechanism [J]. Computer Engineering and Applications, 2021, 57(8): 126-132.
[4]	DONG Xubin, ZHAO Qinghua. Research and Application of Improved Mask R-CNN in Aerial Image Target Detection [J]. Computer Engineering and Applications, 2021, 57(8): 133-144.
[5]	WANG Ling, WANG Jiapei, WANG Peng, SUN Shuangzi. Siamese Network Tracking Algorithms for Hierarchical Fusion of Attention Mechanism [J]. Computer Engineering and Applications, 2021, 57(8): 169-174.
[6]	LI Mingshan, HAN Qingpeng, ZHANG Tianyu, WANG Daolei. Safety Helmet Detection Method of Improved SSD [J]. Computer Engineering and Applications, 2021, 57(8): 192-197.
[7]	HUAI Chuangfeng, GUO Long, JIA Xueyan, ZHANG Zihao. Improved A* Algorithm and Dynamic Window Method for Robot Dynamic Path Planning [J]. Computer Engineering and Applications, 2021, 57(8): 244-248.
[8]	GUO Xiaojing, SUI Haoda. Application of Improved YOLOv3 in Foreign Object Debris Target Detection on Airfield Pavement [J]. Computer Engineering and Applications, 2021, 57(8): 249-255.
[9]	LI Zhongdao, LIU Yuansheng, CHANG Feixiang, ZHANG Jun, LU Ming. Research on UWB and LiDAR Fusion Positioning Algorithm in Indoor Environment [J]. Computer Engineering and Applications, 2021, 57(6): 260-266.
[10]	LIU Chang, QIU Weigen, ZHANG Lichen. Person Re-identification Based on Deformable Mask Alignment Convolution Model [J]. Computer Engineering and Applications, 2021, 57(5): 146-152.
[11]	WANG Changlong, ZHANG Yuandong, MIAO Hong, YANG Yuheng. Application of Double Channel Convolutional Neural Network in Pumpkin Diseases Identification [J]. Computer Engineering and Applications, 2021, 57(5): 183-189.
[12]	HAN Wenjing, LUO Xiaoshu, YANG Rixing. Research on Compound Gesture Recognition Method [J]. Computer Engineering and Applications, 2021, 57(4): 108-113.
[13]	ZHAO Hui, LI Zhiwei, FANG Lufa. Feature Information Enhancement Based Single Shot Multibox Detector Algorithm [J]. Computer Engineering and Applications, 2021, 57(4): 148-154.
[14]	GU Meihua, WANG Miaomiao, LI Liyao, FENG Jing. Color Image Multi-scale Fusion Graying Algorithm [J]. Computer Engineering and Applications, 2021, 57(4): 209-215.
[15]	WANG Dianwei, ZHAO Mengying, LIU Ying, SONG Haijun, XIE Yongjun. Improved R-SSD Panoramic Video Image Vehicle Detection Algorithm [J]. Computer Engineering and Applications, 2021, 57(3): 189-195.

Comparative research on fusion methods for multi-modal face recognition

多模态人脸识别融合方法比较研究

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics