Relationship between roughness of knowledge and conditional information entropy

doi:10.3778/j.issn.1002-8331.2009.21.047

Computer Engineering and Applications ›› 2009, Vol. 45 ›› Issue (21): 160-162.DOI: 10.3778/j.issn.1002-8331.2009.21.047

• 理论科学研究 • Previous Articles Next Articles

Relationship between roughness of knowledge and conditional information entropy

CHEN Feng-juan¹，YAN De-qin²

1.Department of Information Technology，Liaoning University of International Business and Economic，Dalian，Liaoning 116052，China
2.Department of Computer Science，Liaoning Normal University，Dalian，Liaoning 116029，China

Received:2009-05-04 Revised:2009-06-05 Online:2009-07-21 Published:2009-07-21
Contact: CHEN Feng-juan

知识粗糙性和条件信息熵的关系

陈凤娟¹，闫德勤²

1.辽宁对外经贸学院信息技术系，辽宁大连 116052
2.辽宁师范大学计算机与信息技术学院，辽宁大连 116029

通讯作者: 陈凤娟

Abstract

Abstract: At present，there are two views in rough set theory.They are algebra view and information view.The roughness of knowledge embodies the granularity of knowledge in algebra view.Two concepts are defined in information view，which are information entropy of knowledge and conditional information entropy of knowledge.Theorem has been proved that information entropy and roughness of knowledge have corresponding relationships.It establishes the link between algebra view and information view，but they are not one-to-one relationships.By re-prove the theorem on the relationship between information entropy and roughness of knowledge，this paper finds that it is conditional information entropy which exists one-to-one relationship with roughness of knowledge.Then several related theorems are given and proved.

Key words: roughness of knowledge, information entropy, conditional information entropy

摘要： 目前，粗糙集理论存在着两种观点，它们分别是代数观和信息观。在代数观点中，知识粗糙性体现了知识的粒度；而在信息观中，定义了知识的信息熵和条件信息熵。已经有定理证明了信息熵与知识的粗糙性存在对应关系，它建立了代数观和信息观之间的联系，但是这种关系却不是一一对应的。该文通过重新证明知识粗糙性和信息熵的对应关系定理，找到与知识粗糙性存在一一对应关系的是条件信息熵，并给出相关定理及其证明。

关键词: 知识粗糙性, 信息熵, 条件信息熵

CHEN Feng-juan¹，YAN De-qin². Relationship between roughness of knowledge and conditional information entropy[J]. Computer Engineering and Applications, 2009, 45(21): 160-162.

陈凤娟¹，闫德勤². 知识粗糙性和条件信息熵的关系[J]. 计算机工程与应用, 2009, 45(21): 160-162.

[1]	WANG Peng, YE Xueyi, WANG Tao, QIAN Dingwei. Face Recognition Based on Double Variation and Double Space Local Directional Pattern [J]. Computer Engineering and Applications, 2021, 57(4): 91-99.
[2]	JIANG Kui, QIU Yuandong, ZHENG Haocheng. ICMPv6 DDoS Attack Detection Method Based on Information Entropy and LSTM [J]. Computer Engineering and Applications, 2021, 57(21): 148-154.
[3]	SONG Shijie, CHEN Kaiyan, ZHANG Yang. Security Evaluation Framework of Deep Learning Side Channel Analysis from Information Entropy [J]. Computer Engineering and Applications, 2021, 57(17): 138-146.
[4]	ZHANG Nianpeng, WU Xu, ZHU Qiang. Entropy-Based Oversampling Framework [J]. Computer Engineering and Applications, 2021, 57(13): 96-101.
[5]	CHEN Jiancu, WANG Yue, ZHU Xiaofei, LI Zhangyu, LIN Zhihang. Wild Animal Video Object Detection Method Combining Multi-feature Map [J]. Computer Engineering and Applications, 2020, 56(7): 221-227.
[6]	LIN Kezheng, ZHANG Yuanming, LI Haotian. Research on HOG Feature Extraction Algorithm Weighted by Information Entropy [J]. Computer Engineering and Applications, 2020, 56(6): 147-152.
[7]	BAI Fengbo, CHANG Lin, WANG Shifan, LI Bin, WANG Yingjie, ZHOU Hong, LIU Yao. Improved Method Study on Extracting Keywords in Chinese Judgment Documents [J]. Computer Engineering and Applications, 2020, 56(23): 153-160.
[8]	ZHANG Hang, SHENG Zhiwei, ZHANG Shibin, YANG Min. Application of Simhash Algorithm in Text Deduplication [J]. Computer Engineering and Applications, 2020, 56(11): 246-251.
[9]	HUANG Dongmei, LIANG Suling, WANG Zhenhua, SUN Jingqi, XU Shoujue. Dimensionality Reduction Method for Hyperspectral Remote Sensing Image Based on Information Entropy [J]. Computer Engineering and Applications, 2019, 55(6): 191-196.
[10]	LI Yaohua, WANG Xingzhou. Fault Diagnosis of Aircraft Hydraulic System [J]. Computer Engineering and Applications, 2019, 55(5): 232-236.
[11]	ZHANG Hua, CAO Lin. Face Sketch Synthesis Method Combining pHash and Sparse Coding [J]. Computer Engineering and Applications, 2019, 55(22): 187-194.
[12]	LI Peizhen, WANG Bin, NIU Yan, TIAN Cheng, XIANG Jie. Research on EEG Classification of Schizophrenia Based on Information Entropy of Functional Connection [J]. Computer Engineering and Applications, 2019, 55(22): 239-244.
[13]	PENG Shouzhen. Pythagorean Fuzzy Decision-Making Model Based on Information Measures and Its Application [J]. Computer Engineering and Applications, 2019, 55(19): 185-190.
[14]	LIU Jichao, WANG Feng, SONG Peng. Dimension Incremental Feature Selection Algorithm for Missing Data [J]. Computer Engineering and Applications, 2019, 55(17): 95-99.
[15]	CHEN Jia, YOU Xiaoming, LIU Sheng, LI Juan. Entropy-Game Based Multi-Population Ant Colony Optimization [J]. Computer Engineering and Applications, 2019, 55(16): 170-178.

Relationship between roughness of knowledge and conditional information entropy

知识粗糙性和条件信息熵的关系

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics