Algorithm for outlier detection based on principal component analysis and sum of attributes distance

doi:10.3778/j.issn.1002-8331.2009.17.042

Computer Engineering and Applications ›› 2009, Vol. 45 ›› Issue (17): 139-141.DOI: 10.3778/j.issn.1002-8331.2009.17.042

• 数据库、信息处理 • Previous Articles Next Articles

Algorithm for outlier detection based on principal component analysis and sum of attributes distance

ZHANG Zhong-ping,SONG Shao-ying,SONG Xiao-hui

College of Information Science and Engineering，Yanshan University，Qinhuangdao，Hebei 066004，China

Received:2008-04-02 Revised:2008-06-17 Online:2009-06-11 Published:2009-06-11
Contact: ZHANG Zhong-ping

基于PCA及属性距离和的孤立点检测算法

张忠平,宋少英,宋晓辉

燕山大学信息科学与工程学院，河北秦皇岛 066004

通讯作者: 张忠平

Abstract

Abstract: An outlier detection algorithm based on principal component analysis and the sum of attributes distance is proposed.The algorithm firstly extracts the principal components from many attributes satisfying accumulative contribution rate.Simultaneously，by the PCA matrix original dataset is transformed to a new feature space composed of principal component.Then outliers are detected using the approach of the sum of attributes distance in the transformed datasets.The results of the experiment show that the outlier detection algorithm based on principal component analysis and the sum of attributes distance is effective.

Key words: outlier, principal component analysis, accumulative contribution rate, the sum of attributes distance

摘要： 提出了一种基于主分量分析和属性距离和的孤立点检测算法。该方法首先通过主分量分析方法从众多属性中提取出满足累计贡献率的主分量，同时利用PCA变换矩阵把原始数据集转换到由主分量组成的新的特征空间上，之后对转换后的数据集用属性距离和的方法对孤立点进行检测。实验结果证明了基于主分量分析和属性距离和的孤立点检测算法的有效性。

关键词: 孤立点, 主分量分析, 累计贡献率, 属性距离和

ZHANG Zhong-ping,SONG Shao-ying,SONG Xiao-hui. Algorithm for outlier detection based on principal component analysis and sum of attributes distance[J]. Computer Engineering and Applications, 2009, 45(17): 139-141.

张忠平,宋少英,宋晓辉. 基于PCA及属性距离和的孤立点检测算法[J]. 计算机工程与应用, 2009, 45(17): 139-141.

[1]	QIAO Hui, ZHOU Shuisheng. Nolinear Angle 2DPCA and Its Application on Face Recognition [J]. Computer Engineering and Applications, 2021, 57(8): 112-118.
[2]	YU Duo, HUANG Yongdong. Hyperspectral Image Classification Based on SPCA and Domain Transform Recursive Filtering [J]. Computer Engineering and Applications, 2021, 57(4): 199-208.
[3]	FENG Lei, JIANG Lei, XU Hua, GOU Zezhong. Triplet Siamese Network Modulation Recognition Algorithm Based on Network Measurement [J]. Computer Engineering and Applications, 2021, 57(19): 135-141.
[4]	MA Yang, ZHAO Xujun. Multi-source Outlier Detection Algorithm Based on Relevant Subspace [J]. Computer Engineering and Applications, 2021, 57(17): 88-95.
[5]	SHEN Shaoyu, CAI Manchun, LU Tianliang, ZHAO Qi. Intrusion Detection Algorithm based on LFKPCA-DWELM [J]. Computer Engineering and Applications, 2021, 57(17): 130-137.
[6]	ZHOU Yu, ZHU Wenhao, FANG Qian, BAI Lei. Survey of Outlier Detection Methods Based on Clustering [J]. Computer Engineering and Applications, 2021, 57(12): 37-45.
[7]	ZHANG Dongmei, Mairidan Wushouer, Gulanbaier Tuerhong. One-Class Classification Method for High-Dimensional Mixed and Unbalanced Credit Score Data [J]. Computer Engineering and Applications, 2021, 57(10): 233-240.
[8]	LIN Kezheng, ZHANG Yuanming, LI Haotian. Research on HOG Feature Extraction Algorithm Weighted by Information Entropy [J]. Computer Engineering and Applications, 2020, 56(6): 147-152.
[9]	QIU Ningjia, WANG Xiaoxia, WANG Peng, ZHOU Sicheng, WANG Yanchun. Research on Convolutional Neural Network Algorithm Combined with Transfer Learning Model [J]. Computer Engineering and Applications, 2020, 56(5): 43-48.
[10]	HE Huanye, LIN Guoyuan, GU Hao, FANG Menghua. Improved LOF Algorithm in Cloud Virtual Machine Anomaly Detection Scenario [J]. Computer Engineering and Applications, 2020, 56(23): 80-86.
[11]	HUANG Guangjun, DENG Yuanlong. Polarizer Visual Defect Detection and Classification Based on Improved LBP and SVM Algorithm [J]. Computer Engineering and Applications, 2020, 56(22): 251-255.
[12]	QIN Fengting, YANG Youlong, QIU Haiquan. Sparse Subspace-Based Method for Local Outlier Detection [J]. Computer Engineering and Applications, 2020, 56(19): 152-159.
[13]	QIU Ningjia, SHEN Zhuorui, WANG Hui, WANG Peng. Semi-supervised Learning Optimization Algorithm for Communication Spam Text Recognition [J]. Computer Engineering and Applications, 2020, 56(17): 121-128.
[14]	YANG Yongpeng, YANG Zhenzhen, LI Jianlin, LE Jun. Low Rank and Sparse Decomposition and Its Application in Video and Image Processing [J]. Computer Engineering and Applications, 2020, 56(16): 21-30.
[15]	MA Keqin, YANG Yanjiao, QIN Hongwu, GENG Lin, WANG Pidong. K-means Clustering Algorithm Combining Max-Min Distance and Weighted Density [J]. Computer Engineering and Applications, 2020, 56(16): 50-54.

Algorithm for outlier detection based on principal component analysis and sum of attributes distance

基于PCA及属性距离和的孤立点检测算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics