计算机工程与应用 ›› 2019, Vol. 55 ›› Issue (13): 158-164.DOI: 10.3778/j.issn.1002-8331.1803-0438

• 模式识别与人工智能 • 上一篇    下一篇

融入Universum学习的度量学习算法

刘  鸿,陈晓红,张恩豪   

  1. 南京航空航天大学 理学院,南京 211106
  • 出版日期:2019-07-01 发布日期:2019-07-01

Metric Learning Algorithm Integrated with Universum Learning

LIU Hong, CHEN Xiaohong, ZHANG Enhao   

  1. College of Science, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
  • Online:2019-07-01 Published:2019-07-01

摘要: 度量学习通过更真实的刻画样本之间的距离,来提高分类和聚类的精度。GMML(Geometric Mean Metric Learning)在学习度量矩阵[A]时,使得在该度量下同类点之间的距离尽可能小,不同类点之间的距离尽可能大。GMML用来学习的训练样本均为目标类数据,而对于现实存在的为数众多的同领域非目标类数据,即Universum数据并未加以利用,不免造成信息的浪费,针对此,提出一种新的度量学习算法——融入Universum学习的GMML(U-GMML)。U-GMML期望得到一个新的度量矩阵[A],使得同类点之间的距离尽可能小,不同类点之间的距离尽可能大,且Universum数据与目标类数据的距离尽可能大,从而使得所学习的度量矩阵[A]更有利于分类。真实数据集上的实验结果验证了该算法的有效性。

关键词: 度量学习, 测地线凸, 几何平均, Universum学习

Abstract: Metric learning improves the accuracy of classification and clustering by reflecting the distance between samples more realistically. GMML(Geometric Mean Metric Learning) aims to learn metric matrix [A] to make the distance within the same class as small as possible and the distance between different classes as large as possible. The training samples used by GMML are target data, but for the large number of real-world non-target class data, which called Universum data are ignored, result in the waste of domain information hidden in Universum data. This paper proposes a new metric learning algorithm U-GMML based on Universum learning. U-GMML aims to learn a new metric matrix [A] to ensure the distance within the same class samples as small as possible, the distance between different class samples as large as possible, and the distance between the Universum data and the target class data as large as possible. The metric matrix [A] which learned by U-GMML is more efficiency for classification. The experimental results on the real dataset verify the effectiveness of the algorithm.

Key words: metric learning, geodesically convex, geometric mean, Universum learning