关键词: BLEU, 高频词覆盖度, 有效词覆盖度, 召回率

Abstract: Multi-Document Automatic Summarization is an important branch of Natural Language Understanding. But the methods of evaluation of the Multi-Document Automatic Summarization also have many problems which are single and lack of uniform standard. The investigative point in this text is to attempt to give a standard aiming at the covered rate of information of Multi-Document Automatic Summarization. This standard will use a few of parameters: improved BLEU parameter (recall), covered rate of effective phrase with original documents, high frequency phrase covered rate. The experiments have indicated this standard can reflect the covered rate of information of summarization system good or bad, and whether it is near to artificial evaluation results.

Key words: BLEU, high frequency phrase covered rate, covered rate of effective phrase, recall