Algorithm study on missing data imputation based on attribute relevancy

Computer Engineering and Applications ›› 2016, Vol. 52 ›› Issue (6): 74-79.

Previous Articles Next Articles

Algorithm study on missing data imputation based on attribute relevancy

MAO Meijing1, E Xu1，2, TAN Yan1, YANG Mingjing1

1.School of Information Science and Technology, Bohai University, Jinzhou, Liaoning 121000, China
2.Food Science Research Institution, Bohai University, Jinzhou, Liaoning 121000, China

Online:2016-03-15 Published:2016-03-17

基于属性相关度的缺失数据填补算法研究

毛玫静1，鄂旭1，2，谭艳1，杨明婧1

1.渤海大学信息科学与技术学院，辽宁锦州 121000
2.渤海大学食品科学研究院，辽宁锦州 121000

Abstract

Abstract: In view of less accurate in complement problem of incomplete information system, a missing data imputation algorithm is proposed based on attribute relevancy in aquaculture safety warning information system. According to study of the limited tolerance relation and decision rules, a new limited compatibility class is solved by the redefined limited compatibility relation. The relevancy of conditional attributes is introduced to construct a new extended matrix and impute data on the premise of effective guarantee deterministic to realize the completeness warning information system. Taking the missing data imputation of perch cultured as a case and using the data sets to fill verification, it shows the algorithm is superior to others on imputation accuracy and data reinforcement.

Key words: incomplete information system, limited compatibility relation, relevancy, extended matrix, data set

摘要： 针对不完备信息系统的数据缺失填补精度不够高问题，以水产养殖预警信息系统为背景，提出一种基于属性相关度的缺失数据填补算法。在有效保证预警信息系统确定性的前提下，通过研究限制容差关系知识和决策规则，根据新定义的限制相容关系求出缺失对象的限制相容类，同时将条件属性之间的相关度概念引入，构造出一种新的扩展矩阵进行数据填补，实现了系统的完备性。以鲈鱼养殖缺失数据填补为实例，以数据集进行填补验证，结果表明与其他方法相比该算法在填补准确度和时间性能上有明显提高。

关键词: 不完备信息系统, 限制相容关系, 相关度, 扩展矩阵, 数据集

MAO Meijing1, E Xu1，2, TAN Yan1, YANG Mingjing1. Algorithm study on missing data imputation based on attribute relevancy[J]. Computer Engineering and Applications, 2016, 52(6): 74-79.

毛玫静1，鄂旭1，2，谭艳1，杨明婧1. 基于属性相关度的缺失数据填补算法研究[J]. 计算机工程与应用, 2016, 52(6): 74-79.

[1]	WANG Le, HAN Meng, LI Xiaojuan, ZHANG Ni, CHENG Haodong. Review of Classification Methods for Unbalanced Data Sets [J]. Computer Engineering and Applications, 2021, 57(22): 42-52.
[2]	MENG Dongxia，LI Yujian. Oversampling Method for Unbalanced Data by Natural Nearest Neighbor [J]. Computer Engineering and Applications, 2021, 57(2): 91-96.
[3]	CHEN Fei, LIU Yunpeng, LI Siyuan. Survey of Traffic Sign Detection and Recognition Methods in Complex Environment [J]. Computer Engineering and Applications, 2021, 57(16): 65-73.
[4]	ZHOU Yu, ZHU Wenhao, FANG Qian, BAI Lei. Survey of Outlier Detection Methods Based on Clustering [J]. Computer Engineering and Applications, 2021, 57(12): 37-45.
[5]	LI Yan, LUI Jun. Joint Segmentation of Full Convolutional Deep Migration Network [J]. Computer Engineering and Applications, 2021, 57(1): 227-233.
[6]	XU Lingling, CHI Dongxiang. Machine Learning Classification Strategy for Imbalanced Data Sets [J]. Computer Engineering and Applications, 2020, 56(24): 12-27.
[7]	DU Miao, YU Qin, LUO Ruisen. Hypersphere Algorithm for Classification on Dynamic Feature Space [J]. Computer Engineering and Applications, 2020, 56(22): 148-153.
[8]	MENG Dongxia, LI Yujian. Oversampling Method for Unbalanced Data Based on Information of Characteristic Boundary [J]. Computer Engineering and Applications, 2020, 56(14): 156-160.
[9]	FU Bowen, TANG Xianghong, XIAO Tao. Research on Focal Loss Function Applied to Image Emotion Analysis [J]. Computer Engineering and Applications, 2020, 56(10): 179-184.
[10]	LU Kai, XU Hua. Efficient ML-kNN Algorithm on Large Data Set [J]. Computer Engineering and Applications, 2019, 55(1): 84-88.
[11]	MA Zhen, HALIDAN Abudureyimu, LI Xitong. Research on access optimization of small files in massive sample data sets [J]. Computer Engineering and Applications, 2018, 54(22): 80-84.
[12]	YAN Jianhong. Optimization boosting classification based on metrics of imbalanced data [J]. Computer Engineering and Applications, 2018, 54(21): 128-132.
[13]	GUO Wenqiang, GAO Wenqiang, HOU Yongyan, LI Ran. Target recognition based on BN parameter learning under scarce data set [J]. Computer Engineering and Applications, 2018, 54(17): 122-125.
[14]	ZHAO Huanhuan1, JIAN Lirong1, LIU Yong2. Variable precision rough set model based on set pair homeopathic similar relationship [J]. Computer Engineering and Applications, 2017, 53(6): 51-56.
[15]	QIU Guanghui, TANG Dingyong. Extended rough set model based on weighted characteristic relation [J]. Computer Engineering and Applications, 2016, 52(23): 98-101.

Algorithm study on missing data imputation based on attribute relevancy

基于属性相关度的缺失数据填补算法研究

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics