Automatic identifying query interfaces of deep Web with maximum entropy classifier

doi:10.3778/j.issn.1002-8331.2008.21.037

Computer Engineering and Applications ›› 2008, Vol. 44 ›› Issue (21): 133-137.DOI: 10.3778/j.issn.1002-8331.2008.21.037

• 机器学习 • Previous Articles Next Articles

Automatic identifying query interfaces of deep Web with maximum entropy classifier

FANG Wei^1,2,HUANG Li^1,2,CUI Zhi-ming^1,2

1.Jiangsu Key Laboratory of Computer Information Processing Technology，Soochow University，Suzhou，Jiangsu 215006，China
2.Institute of Intelligent Information Processing and Application，Soochow University，Suzhou，Jiangsu 215006，China

Received:2008-04-30 Revised:2008-06-06 Online:2008-07-21 Published:2008-07-21
Contact: FANG Wei

基于最大熵分类器的Deep Web查询接口自动判定

方巍^1,2,黄黎^1,2,崔志明^1,2

1.江苏省计算机信息处理技术重点实验室，江苏苏州 215006
2.苏州大学智能信息处理及应用研究所，江苏苏州 215006

通讯作者: 方巍

Abstract

Abstract: Tremendous high-quality web information is deeply hidden in the Web，which can not be indexed by traditional search engines，so we call them Deep Web.Since query interface is the only entrance to the Deep Web，we must distinguish query interfaces of Deep Web.Since the Maximum Entropy Model could integrate various correlative and irrelative probability knowledge，it could deal with many problem well.So we use Maximum Entropy Model for query interface categorization in this paper.Compared with Bayes，C4.5 and SVM，Maximum Entropy shows its high quality.Moreover，it is useful to query interface categorization.

Key words: deep web, Html form, feature extraction, maximum entropy model

摘要： Web中包含着海量的高质量信息，它们通常处在网络深处，无法被传统搜索引擎索引，将这样的资源称为Deep Web。因为查询接口是Deep Web的唯一入口，所以要获取Deep Web信息就必须判定哪些网页表单是Deep Web查询接口。由于最大熵模型可以综合观察到的各种相关或不相关的概率知识，对许多问题的处理都可以达到较好的结果。因此，基于最大熵模型的分类性能，利用最大熵分类算法自动判定查询接口。并通过实验，将最大熵分类法与其它常用分类方法进行了比较，结果显示它的分类性能优于Bayes方法和C4.5方法，与SVM方法相当，表明这是一种非常实用的查询接口分类方法。

关键词: Deep Web, 网页表单, 特征提取, 最大熵模型

FANG Wei^1,2,HUANG Li^1,2,CUI Zhi-ming^1,2. Automatic identifying query interfaces of deep Web with maximum entropy classifier[J]. Computer Engineering and Applications, 2008, 44(21): 133-137.

方巍^1,2,黄黎^1,2,崔志明^1,2. 基于最大熵分类器的Deep Web查询接口自动判定[J]. 计算机工程与应用, 2008, 44(21): 133-137.

[1]	BAO Zhiqiang, XING Yu, LYU Shaoqing, HUANG Qiongdan. Improved YOLO V2 6D Object Pose Estimation Algorithm [J]. Computer Engineering and Applications, 2021, 57(9): 148-153.
[2]	XU Degang, WANG Lu, LI Fan. Review of Typical Object Detection Algorithms for Deep Learning [J]. Computer Engineering and Applications, 2021, 57(8): 10-25.
[3]	HU Wentao, CHEN Xiuhong. Low-Rank Projection Learning Based on Neighbor Graph [J]. Computer Engineering and Applications, 2021, 57(7): 209-214.
[4]	ZHANG Xiaoli, ZHANG Kuixing, JIANG Mei, WEI Benzheng, CONG Jinyu. Review of Image Classification Technology for Lymphoma [J]. Computer Engineering and Applications, 2021, 57(6): 1-9.
[5]	XIONG Jian, QIN Renchao, HE Mengyi, LIU Jianlan, TANG Fengyang. Application of Improved Random Forest Algorithm in Android Malware Detection [J]. Computer Engineering and Applications, 2021, 57(3): 130-136.
[6]	LI Longlong, HE Dongjian, WANG Meili. Study of Plant Leaf Image Recognition Based on Improved Local Binary Pattern Algorithm [J]. Computer Engineering and Applications, 2021, 57(19): 228-234.
[7]	LI Jie, LI Miao, YUAN Xiguo. Detection Algorithm?of Pathogenic Microbes from Next-Generation Sequencing Data [J]. Computer Engineering and Applications, 2021, 57(19): 282-289.
[8]	GUO Hengguang, LIU Wenbiao, YU Renbo. Shape Feature Extraction Using Spike Function [J]. Computer Engineering and Applications, 2021, 57(18): 220-226.
[9]	LI Zhenqiang, WANG Shucai, ZHAO Shida, BAI Yu. Cutting Methods of Sheep’s Trunk Based on Improved DeepLabv3+ and XGBoost [J]. Computer Engineering and Applications, 2021, 57(18): 263-269.
[10]	LIU Xingchen, JIA Juncheng, ZHANG Li, HU Qinhan. Feature Concentration Network for Image Super-Resolution [J]. Computer Engineering and Applications, 2021, 57(16): 213-219.
[11]	GUANG Ruizhi, AN Bowen, PAN Shengda. Channel Ship Detection Algorithm for Aerial Image Based on Anchor-Free Network [J]. Computer Engineering and Applications, 2021, 57(15): 251-258.
[12]	ZHOU Xiaojing, CHEN Junhong, YANG Zhenguo, LIU Wenyin. Manipulation Action Recognition Based on Gesture Feature Fusion [J]. Computer Engineering and Applications, 2021, 57(14): 169-175.
[13]	YUE Qi, XU Zhongliang, GUO Jifeng. Sparse Feature Extraction Method for Mixed Instruments Music Analysis [J]. Computer Engineering and Applications, 2021, 57(14): 181-186.
[14]	CHEN Guihui, CHEN Wu, LI Zhongbing, YI Xin, LIU Huikang, HAN Chunyang. Image Super Resolution Reconstruction Based on Residual Convolution Attention Network [J]. Computer Engineering and Applications, 2021, 57(12): 193-200.
[15]	ZHENG Linwen, ZHOU Jinzhi, HUANG Jing. Application of Deep Sparse Auto-Encoders in ECG Feature Extraction [J]. Computer Engineering and Applications, 2021, 57(11): 156-161.

Automatic identifying query interfaces of deep Web with maximum entropy classifier

基于最大熵分类器的Deep Web查询接口自动判定

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics