基于多特征融合与CELM的场景分类算法

doi:10.3778/j.issn.1002-8331.2007-0466

摘要/Abstract

摘要： 场景分类对于场景图像的语义解译至关重要，是遥感领域近期的主要研究课题之一。针对大部分图像分类方法中提取的特征结构单一，依赖于大量人工标记的数据以及分类器的训练过程缓慢等问题，提出了一种基于多特征融合与约束极限学习机（constrained extreme learning machines，CELM）的场景图像分类方法。该方法采用三种不同结构的预训练卷积神经网络，利用特定数据集对其进行微调，将微调后网络提取到的三种特征进行融合并送入CELM分类器进行分类，最终得到图像的类别标签。以SIRI-WHU、WHU-RS19与UC-Merced数据集作为实验数据集，在预训练卷积神经网络、单一特征和传统分类器上进行的对比实验表明，基于多特征融合与CELM相结合的方法产生了较好的分类效果，三种数据集上的总分类精度分别高达99.25%、98.26%与97.70%。

关键词: 场景分类, 多特征融合, 约束极限学习机

Abstract: Scene classification is significant for scene imagery semantic interpretation, which is one of the main research topics of remote sensing filed. The traditional image classification methods usually extract the insufficient features with much time in training its classifier. In addition, it relies on large number of manually labeled data. Aiming at solving these problems, this paper proposes a scene image classification model based on multi-feature and constrained extreme learning machine（CELM）. There are two main processes of the proposed method. Firstly, three pre-trained convolutional neural networks with different architectures are fine-tuned using the experimental dataset. Secondly, the features extracted are fused and feed to CELM classifier, obtaining the category label. SIRI-WHU, WHU-RS19 and UC-Merced datasets are taken as the experimental datasets, the experiments on pre-trained CNNs, single features and traditional classifiers show that the proposed method produces the comparable classification performance, with the accuracy of 99.25%, 98.26% and 97.70%.

Key words: scene classification, multi-feature fusion, constrained extreme learning machine

王光, 陶燕, 沈慧芳, 周树东. 基于多特征融合与CELM的场景分类算法[J]. 计算机工程与应用, 2022, 58(1): 232-240.

WANG Guang, TAO Yan, SHEN Huifang, ZHOU Shudong. Multi-feature Fusion and Constrained Extreme Learning Machine for Scene Classification[J]. Computer Engineering and Applications, 2022, 58(1): 232-240.

参考文献

[1] YANG W，YIN X，XIA G S.Learning high-level features for satellite image classification with limited labeled samples[J].IEEE Transactions on Geoence and Remote Sensing，2015，53（8）：4472-4482.
[2] SHAO Y X.Extreme value theory-based calibration for the fusion of multiple features in high-resolution satellite scene classification[J].International Journal of Remote Sensing，2013，34（23）：8588-8602.
[3] CHERIYADAT A M.Unsupervised feature learning for satellite image classification with limited labeled samples[J].IEEE Transactions on Geoence and Remote Sensing，2015，52（1）：439-451.
[4] YANG Y，NEWSAM S.Bag-of-visual-words and spatial extensions for land-use classification[C]//Sigspatial International Conference on Advances in Geographic Information Systems，2010：270.
[5] ZHOU L，ZHOU Z，HU D.Scene classification using a multi-resolution bag-of-features model[J].Pattern Recognition，2013，46（1）：424-433.
[6] LAZEBNIK S，SCHMID C，PONCE J.Beyond bags of features：Spatial pyramid matching for recognizing natural scene categories[C]//Proceedings of Conference on Computer Vision and Pattern Recognition，2006.
[7] HU F，XIA G S，WANG Z，et al.Unsupervised feature learning via spectral clustering of multidimensional patches for remotely sensed scene classification[J].IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing，2017，8（5）：2015-2030.
[8] RISOJEVI? V，BABI? Z.Unsupervised quaternion feature learning for remote sensing image classification[J].IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing，2016，9（4）：1521-1531.
[9] OTHMANA E，BAZI Y，ALAJLAN N，et al.Using convolutional features and a sparse autoencoder for land-use scene classification[J].International Journal of Remote Sensing，2016，37（10）：2149-2167.
[10] CHEN Y，ZHAO X，JIA X.Spectral-spatial classification of hyperspectral data based on deep belief network[J].IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing，2015，8（6）：2381-2392.
[11] 张康，黑保琴，李盛阳，等.基于CNN模型的遥感图像复杂场景分类[J].国土资源遥感，2018，30（4）：52-58.
ZHANG K，HEI B Q，LI S Y，et.al.Complex scene classification of remote sensing images based on CNN[J].Remote Sensing for Land & Resources，2018，30（4）：52-58.
[12] FLORES E，ZORTEA M，SCHARCANSKI J.Dictionaries of deep features for land-use scene classification of very high spatial resolution images[J].Pattern Recognition，2019，89：32-44.
[13] SAUNDERS C，STITSON M O，WESTON J，et al.Support vector machine[J].Computer Sience，2002，1（4）：1-28.
[14] HUANG G B，ZHU Q Y，SIEW C K.Extreme learning machine：Theory and applications[J].Neurocomputing，2006，70（1/3）：489-501.
[15] KANNOJIA S P，JAISWAL G.Ensemble of hybrid CNN-ELM model for image classification[C]//Proceedings of International Conference on Signal Processing & Integrated Networks，2018：538-541.
[16] ZHU W，MIAO J，QING L.Constrained extreme learning machines：A study on classification cases[J].arXiv：1501.
06115，2015.