关键词: 中文XML文档, 数据压缩, 中文分词, 词典

Abstract: To overcome the shortcoming of the current XML compression algorithms which do not distinguish between Chinese characters and English words, it presents a Chinese-oriented XML compressor with high compression ratio, called COX. The input documents are preprocessed by using the technology of Chinese word segmentation, the sorted dictionary is obtained by counting the word frequency, and then the high-frequency and long-size words are coded by using the Huffman coding method. The items in the XML documents are classified by analyzing the documents, the items with the same class tag are sent to the same container. Moreover, the numerical data are processed especially in COX. The experimental results show that, compared to the general compression algorithms, COX achieves higher compression ratio if the XML documents contain more Chinese words, while needing more compression and decompression time as return.

Key words: Chinese XML document, data compression, Chinese word segmentation, dictionary