关键词: 图像质量评估, 主观评估, 评估系统, 平均意见得分（MOS）, 双确认评估, 标签隐藏, 次序隐藏

Abstract:

Image quality assessment plays an important role in the developments of various image processing techniques. The current subjective assessment of image quality has a complex evaluation process and thus is inefficient. Furthermore, the evaluation results could be easily effected by a possible bias of the evaluators. To solve the above-mentioned problems, a system is designed for conducting a reliable and effective subjective assessment. In this system, the label and order of each image sample are hidden, so that the possible bias of the evaluators can be effectively eliminated. This paper also adopts a strategy of double confirmation for each evaluation score, and analyzes the evaluation results by using the Mean Opinion Score（MOS）. To verify the efficiency of the developed system, a subjective assessment of the state-of-the-art algorithms for line segment detection is conducted finally.

Key words: image quality assessment, subjective assessment, assessment system, Mean Opinion Score（MOS）, double-confirmed assessment, label hiding, order hiding