Induction of decision tree based on rough sets technique

doi:10.3778/j.issn.1002-8331.2009.18.014

Computer Engineering and Applications ›› 2009, Vol. 45 ›› Issue (18): 45-47.DOI: 10.3778/j.issn.1002-8331.2009.18.014

• 研究、探讨 • Previous Articles Next Articles

Induction of decision tree based on rough sets technique

ZHAI Jun-hai¹,WANG Xi-zhao¹,ZHANG Cang-sheng²

1.Key Lab of Machine Learning and Computational Intelligence，College of Mathematics and Computer Science，Hebei University，Baoding，Hebei 071002，China
2.Computing Center，Hebei University，Baoding，Hebei 071002，China

Received:2008-12-15 Revised:2009-02-18 Online:2009-06-21 Published:2009-06-21
Contact: ZHAI Jun-hai

基于粗糙集技术的决策树归纳

翟俊海¹,王熙照¹,张沧生²

1.河北大学数学与计算机学院河北省机器学习与计算智能重点实验室，河北保定 071002
2.河北大学计算中心，河北保定 071002

通讯作者: 翟俊海

Abstract

Abstract: The ID3 algorithm is a typical decision tree induction method.Information gain measure is utilized to select optimal attributes with minimum entropy.Decision tree is recursively generated.However，there is natural bias in the information gain measure that favors attributes with many values over those with few values.Moreover，it assumes that the distribution of all classes’ instances in the training set is same with the real problems.This paper presents a novel decision tree induction method，which is purely driven by the data used，and can overcome the drawbacks mentioned above.

Key words: decision tree, ID3 algorithm, rough sets, upper approximations, lower approximations

摘要： ID3算法是一种典型的决策树归纳算法，它以信息增益作为选择扩展属性根结点的标准，并递归地生成决策树。但ID3算法倾向于选取属性取值较多的属性作为根结点，而且它假设训练集中各类别样例的比例应与实际问题领域里各类别样例的比例相同。提出一种新的基于粗糙集技术的决策树归纳算法，它是一种完全数据驱动的归纳算法，可以克服ID3算法的上述不足。

关键词: 决策树, ID3算法, 粗糙集, 上近似, 下近似

ZHAI Jun-hai¹,WANG Xi-zhao¹,ZHANG Cang-sheng². Induction of decision tree based on rough sets technique[J]. Computer Engineering and Applications, 2009, 45(18): 45-47.

翟俊海¹,王熙照¹,张沧生². 基于粗糙集技术的决策树归纳[J]. 计算机工程与应用, 2009, 45(18): 45-47.

[1]	ZHANG Min, PENG Hongwei, YAN Xiaoling. Improved Algorithm of Fuzzy Decision Tree Based on Neural Network [J]. Computer Engineering and Applications, 2021, 57(21): 174-179.
[2]	ZHANG Jianhua, LI Fangfang, YANG Lan. Research on Matching Supply and Demand of Case Knowledge Based on PFS and RS [J]. Computer Engineering and Applications, 2020, 56(23): 139-145.
[3]	TAN Zhenghua, DAI Liping, WEN Yang, LI Guotai. Decision Tree Construction Method Based on Reduction Attribute and Threshold Segmentation [J]. Computer Engineering and Applications, 2020, 56(22): 160-165.
[4]	WANG Limiao, XU Qinglin, JIANG Wenchao, FU Jigao. Short Video Preference Rate Prediction Model with Integrated FM [J]. Computer Engineering and Applications, 2020, 56(14): 118-122.
[5]	Yibulayin·Wusiman, GUO Wenqiang, YU Kai. Research on Filtering Algorithm for Senstive Information in Multi-form Uyghur [J]. Computer Engineering and Applications, 2020, 56(10): 127-133.
[6]	REN Jun1, TANG Qiwen1, XU Yi2, HU Shanzhong2. Research on Multi Granularity Rough Set for University Students’ Poverty Support Evaluation [J]. Computer Engineering and Applications, 2019, 55(7): 82-86.
[7]	QI Meilan, LI Xiaonan. Matroidal Structure Based on Set-Valued Mapping and Its Relationship with Covering Rough Sets [J]. Computer Engineering and Applications, 2019, 55(6): 50-56.
[8]	SU Chong, REN Tong, WANG Guopin, YIN Jie. Using K-L Divergence Based Decision Tree to Build Traditional Chinese Medicine Diagnosis Model on COPD [J]. Computer Engineering and Applications, 2019, 55(3): 225-230.
[9]	WANG Yuyuan, XU Jie, JI Weixi. Intelligent Recognition Method for Geometric Features of Parts Based on Supervised Machine Learning [J]. Computer Engineering and Applications, 2019, 55(22): 225-230.
[10]	LIU Junjie, WANG Jun, WANG Menglin, WANG Yue. DDoS Attack Detection Based on C4.5 in SDN [J]. Computer Engineering and Applications, 2019, 55(20): 84-88.
[11]	WANG Yan, GUO Yuankai. Application of Improved XGBoost Model in Stock Forecasting [J]. Computer Engineering and Applications, 2019, 55(20): 202-207.
[12]	CAO Weidong1，2, XU Daidai2, WANG Jing2, WANG Jialiang2. NOSHOW Prediction and Strong Factor Association Analysis in Civil Aviation [J]. Computer Engineering and Applications, 2019, 55(2): 221-227.
[13]	PENG Lisha, QIAN Wenbin, WANG Yinglong, SHU Wenhao. Incomplete Neighborhood System Oriented Three-Way Decisions Granular Computing Method [J]. Computer Engineering and Applications, 2019, 55(18): 53-60.
[14]	LIU Jichao, WANG Feng, SONG Peng. Dimension Incremental Feature Selection Algorithm for Missing Data [J]. Computer Engineering and Applications, 2019, 55(17): 95-99.
[15]	ZHAO Pan1, YUAN Jie1, WANG Hongwei1，2, MI Tang1. Research on Autonomous Decision-Making of Plume Tracking Robots Using Decision Tree [J]. Computer Engineering and Applications, 2019, 55(14): 254-259.

Induction of decision tree based on rough sets technique

基于粗糙集技术的决策树归纳

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics