计算机工程与应用 ›› 2017, Vol. 53 ›› Issue (13): 95-98.DOI: 10.3778/j.issn.1002-8331.1607-0127

• 大数据与云计算 • 上一篇    下一篇

基于Hadoop的中医哮喘用药组合关联分析

陈亚楠,朱习军   

  1. 青岛科技大学,山东 青岛 266061
  • 出版日期:2017-07-01 发布日期:2017-07-12

Association analysis of TCM asthma medication combination based on Hadoop

CHEN Yanan, ZHU Xijun   

  1. Qingdao University of Science and Technology, Qingdao, Shandong 266061, China
  • Online:2017-07-01 Published:2017-07-12

摘要:

针对传统平台运行Apriori算法来挖掘中医病案中用药组合规律时,存在着占用内存空间大、计算效率低和PB级数据无法处理等问题,提出基于Hadoop的中医哮喘用药组合关联分析方法。采用Mapreduce分布式计算框架和HBase分布式数据库优化Apriori算法性能:一方面使用Mapreduce计算框架并行处理数据,借助HBase高速读写数据的特性,加速频繁项集的产生;另一方面摒弃传统算法中的自连接产生候选项集方式,对每个节点上的数据,使用循环和递归相结合的方式产生候选集,提高候选集产生的效率。实验结果证明,借助基于Hadoop的中医哮喘用药组合关联分析方法挖掘中医药组合规律,效率更高,能更有效地指导临床实践。

关键词: Apriori算法, MapReduce计算框架, 哮喘用药组合, HBase分布式数据库

Abstract: On the traditional platform running Apriori algorithm to mining the TCM asthma medication combination rules, there are problems: Occupying a large memory space, low computational efficiency, and PB byte data can not be processed with. Thus this paper puts forward analysis method to mining associations of asthma medicine in TCM treatment based on Hadoop. Using Mapreduce distributed computing framework and HBase distributed database to optimized Apriori algorithm performance: on the one hand parallel processing data with Mapreduce computing framework, combine with characteristic of HBase high speed of read and write data, which accelerate the production of frequent item sets; On the other hand ?abandoned the traditional algorithm self join way of generated candidate sets. Using a combination of loops and recursive way to generation candidate sets for data of each node instead, which improve the candidate set generation efficiency. Experiments show that the use of Hadoop platform to mine the combination of TCM asthma medication, which has higher efficiency, and can more effectively guide clinical practice.

Key words: Apriori algorithm, MapReduce computing framework, asthma medication combination, HBase distributed database