计算机工程与应用 ›› 2019, Vol. 55 ›› Issue (21): 189-196.DOI: 10.3778/j.issn.1002-8331.1807-0070

• 图形图像处理 • 上一篇    下一篇

融合强化学习和关系网络的样本分类

张碧陶,庞振全   

  1. 1.江西理工大学 电气工程与自动化学院,江西 赣州 341000
    2.广州市香港科大霍英东研究院,广州 511458
  • 出版日期:2019-11-01 发布日期:2019-10-30

Sample Classification of Fusion Reinforcement Learning and Relational Networks

ZHANG Bitao, PANG Zhenquan   

  1. 1.School of Electrical Engineering and Automation, Jiangxi University of Science and Technology, Ganzhou, Jiangxi 341000, China
    2.Guangzhou HKUST Fok Ying Tung Research Institute, Guangzhou 511458, China
  • Online:2019-11-01 Published:2019-10-30

摘要: 针对少量训练样本在深度学习算法中难以实现高精度分类的问题,提出一种融合强化学习和关系网络的小样本分类算法。采用图像预处理过程中基于强化学习的美学意识图像自动裁剪模型,通过构建美学意识奖励函数来输出最佳裁剪图像,从而保留图像最具特征部分。利用关系网络模型,将自动裁剪后的小样本图像中的训练样本图像与测试图像通过关系网络中的嵌入模块进行特征提取。将提取后的特征进行特征映射级联,并将级联后的特征映射馈送到关系网络中的关系模块中进行比较,将最终产生的0到1范围内的关系评分作为比较结果,从而判断测试图像所属的类别。在小样本数据集上进行实验并与现有方法进行对比,实验表明该方法能够实现较高精度的小样本分类。

关键词: 小样本分类, 强化学习, 自动裁剪, 关系网络, 特征映射

Abstract: For the difficulty of achieving high-precision classification in deep learning algorithms for small training samples, a small-sample classification algorithm based on reinforcement learning and relational network is proposed. An automatic cropping model based on reinforcement learning aesthetic aware is adopted in the process of image preprocessing, and an optimal cropped image is output by constructing an aesthetic aware reward function so as to retain the most characteristic part of the image. The relation network architecture is utilized, the training samples and test samples in the auto-cropped small-sample image are subjected to extract feature through an embedded module in the relation network. The extracted features are cascaded to the feature map, and the cascaded feature maps are fed into the relational module in the relational network for comparison, and the resulting relation scores in the range of 0 to 1 are used as comparison results to determine the category to which the test samples belong. Experiments on small-sample datasets and comparison with the existing methods, experiments show that this method can achieve high precision of small-sample classification.

Key words: small-sample classification, reinforcement learning, automatic cropping, relational network, feature maps