Topology-based document similarity search algorithm

Computer Engineering and Applications ›› 2011, Vol. 47 ›› Issue (26): 146-150.

• 数据库、信号与信息处理 • Previous Articles Next Articles

Topology-based document similarity search algorithm

YANG Yan1，2，ZHU Ge1，FAN Wenbin1

1.School of Computer Science and Technology，Heilongjiang University，Harbin 150080，China
2.The Key Laboratory of Computational Biology，Heilongjiang University，Harbin 150080，China

Received:1900-01-01 Revised:1900-01-01 Online:2011-09-11 Published:2011-09-11

一种基于文档拓扑的相似性搜索算法

杨艳1，2，朱戈1，范文彬1

1.黑龙江大学计算机科学技术学院，哈尔滨 150080
2.黑龙江大学计算生物学重点实验室，哈尔滨 150080

Abstract

Abstract: Searching for similar documents from the large number of documents quickly and efficiently is an important and time-consuming problem.The existing algorithms first find the candidate document set，and then sort them based on a document related evaluation to identify the most relevant ones.A topology-based document similarity search algorithm——Hub-N is put forward，and the document similarity search problem is transformed into graph search problem，applying the pruning techniques，reducing the scope of scanned documents，and significantly improving retrieval efficiency.It proves to be effective and feasible through experiment.

Key words: document topology, similarity search, similarity

摘要： 从海量文档中快速有效地搜索到相似文档是一个重要且耗时的问题。现有的文档相似性搜索算法是先找出候选文档集，再对候选文档进行相关性排序，找出最相关的文档。提出了一种基于文档拓扑的相似性搜索算法——Hub-N，将文档相似性搜索问题转化为图搜索问题，应用相应的剪枝技术，缩小了扫描文档的范围，提高了搜索效率。通过实验验证了算法的有效性和可行性。

关键词: 文档拓扑, 相似性搜索, 相似度

YANG Yan1，2，ZHU Ge1，FAN Wenbin1. Topology-based document similarity search algorithm[J]. Computer Engineering and Applications, 2011, 47(26): 146-150.

杨艳1，2，朱戈1，范文彬1. 一种基于文档拓扑的相似性搜索算法[J]. 计算机工程与应用, 2011, 47(26): 146-150.

[1]	ZHANG Qishan, CHEN Lulu. Slope One Algorithm Based on Grey Correlational Analysis by Method of Degree of Balance and Approach [J]. Computer Engineering and Applications, 2021, 57(9): 96-102.
[2]	WANG Yonggui, LI Qianyu. Hybrid Collaborative Filtering Recommendation Algorithm Based on KNN-GBDT [J]. Computer Engineering and Applications, 2021, 57(9): 103-108.
[3]	ZHANG Songcan, PU Jiexin, SI Yanna, SUN Lifan. Adaptive Improved Ant Colony Algorithm Based on Population Similarity and Its Application [J]. Computer Engineering and Applications, 2021, 57(8): 70-77.
[4]	ZHANG Xiaowen, REN Yongfeng. Image Matching Algorithm Combining Sparse Representation and Topological Similarity [J]. Computer Engineering and Applications, 2021, 57(8): 198-203.
[5]	YANG Fang, YIN Xi, SI Jianhui, LIU Hongyuan, WANG Xue. Mathematical Expression Similarity Calculation Method Based on Focus Clustering [J]. Computer Engineering and Applications, 2021, 57(6): 88-93.
[6]	QIAN Yunyun, YANG Wenzhong, YAO Miao, LI Hailei, CHAI Yachuang. Topic Community Discovery Model Incorporating Topic Similarity Weight [J]. Computer Engineering and Applications, 2021, 57(5): 107-114.
[7]	JIANG Bin, LIANG Xiao’an, ZHANG Liang, GAO Yangjun. Evidence Combination Method Based on Improved Modified Weight [J]. Computer Engineering and Applications, 2021, 57(24): 100-106.
[8]	TIAN Wei’an, CHEN Hongmei, ZHOU Lihua. Diversified Recommendation Method Based on Similar Users’Curiosity [J]. Computer Engineering and Applications, 2021, 57(23): 113-121.
[9]	LIANG Tian, CAO Dexin. Improved and Simplified Particle Swarm Optimization Algorithm Based on Levy Flight [J]. Computer Engineering and Applications, 2021, 57(20): 188-196.
[10]	WEI Dingfeng, LI Liang, CHAI Jing. Social Recommendation Algorithm by Fusing Item Information [J]. Computer Engineering and Applications, 2021, 57(19): 198-204.
[11]	LIU Li. Top-N Recommendation Algorithm Based on User Diversity Preference [J]. Computer Engineering and Applications, 2021, 57(17): 116-121.
[12]	YANG Yanjiao, ZHAO Guotao, WANG Pidong. Sentence Similarity Calculation Method Based on Semantics and Emotion [J]. Computer Engineering and Applications, 2021, 57(16): 151-158.
[13]	ZHANG Tao, YU Jiong, LIAO Bin, BI Xuehua. Method for Attributed Graph Summarization Based on Minimum Description Length [J]. Computer Engineering and Applications, 2021, 57(15): 124-132.
[14]	ZHAO Qi, DU Yanhui, LU Tianliang, SHEN Shaoyu. Algorithm of Text Similarity Analysis Based on Capsule-BiGRU [J]. Computer Engineering and Applications, 2021, 57(15): 171-177.
[15]	SHI Chen, ZHANG Yu, HU Bo. Model for Near-Synonym/Synonym Phrase Finding Based on Common Surrounding Context [J]. Computer Engineering and Applications, 2021, 57(14): 142-147.

Topology-based document similarity search algorithm

一种基于文档拓扑的相似性搜索算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics