关键词: 传统维文, 拉丁维文, 敏感信息, 决策树

Abstract:

The existing research on Uyghur sensitive information detection and filtering is limited to traditional Uyghur. Now Uyghur on the Internet uses the “one-word double-text” feature of traditional Uyghur and Latin Uyghur. The sensitive information filtering algorithm of the text realizes the filtering of the sensitive information of traditional Uyghur and Latin Uyghur, which has important practical significance for the network security and social stability of Xinjiang and the realization of the overall goal of lasting stability. The coding rules of Latin Uyghur and traditional Uyghur are studied by putting forward the ULTC（Uyghur Latin Traditional Conversion）, which is a code conversion algorithm between them. By adding the Latin Uyghur sensitive information corpora to the existing traditional Uyghur sensitive information corpora, a multi-form Uyghur sensitive information corpus is constructed. Based on the corpus of ULSC（Uyghur Latin Sensitive Corpus）, a method for calculating the multi-form Uyghur sensitive values is proposed, and a multi-form Uyghur sensitive information decision tree LUDT（Latin Uyghur Decision Tree） that integrates traditional Uyghur and Latin Uyghur is constructed. Based on LUDT, the multi-form Uyghur Sensitive Information Filtering（USF） algorithm is proposed. Experimental results show that the USF algorithm has a high recall rate.

Key words: traditional Uyghur, Latin Uyghur, sensitive information, decision tree