Computer Engineering and Applications ›› 2022, Vol. 58 ›› Issue (24): 29-46.DOI: 10.3778/j.issn.1002-8331.2206-0055

• Research Hotspots and Reviews • Previous Articles     Next Articles

Review of Graph Convolutional Neural Networks in Point Cloud Semantic Segmentation

ZHANG Rui, MENG Xiaoman, ZENG Zhiyuan, JIN Wei, WU Yichao   

  1. School of Information Engineering, North China University of Water Resources and Electric Power, Zhengzhou 450046, China
  • Online:2022-12-15 Published:2022-12-15

图卷积神经网络在点云语义分割中的研究综述

张蕊,孟晓曼,曾志远,金玮,武益超   

  1. 华北水利水电大学 信息工程学院,郑州 450046

Abstract: Point cloud contains rich spatial information, which can be collected in large quantities with lidar, 3D sensors and other equipment, and is widely used in the fields of autonomous driving, virtual reality, urban planning and 3D reconstruction. Point cloud semantic segmentation has received wide attention as the basis for 3D scene understanding, recognition and various applications. However, irregular point cloud data cannot be directly used as the input of traditional convolutional neural networks, while graph convolutional neural networks can directly extract features from point cloud data using graph convolution operators, making graph convolutional neural networks have gradually become an important research direction in the field of point cloud semantic segmentation. Based on this, this paper reviews the research progress of graph convolutional neural network in 3D point cloud semantic segmentation application. Firstly, the point cloud semantic segmentation methods based on graph convolution are classified according to the types of graph convolution, and the model architectures and characteristics of mainstream methods are compared and analyzed according to different categories. Then, several common public datasets and evaluation metrics in the related point cloud semantic segmentation field are described. Finally, a summary and prospect of point cloud semantic segmentation methods are presented.

Key words: semantic segmentation, 3D point cloud, graph convolutional neural network, deep learning

摘要: 点云数据蕴含丰富的空间信息,可以通过激光雷达、3D传感器等设备大量采集,被广泛应用于自动驾驶、虚拟现实、城市规划和3D重建等领域。点云语义分割作为3D场景理解、识别和各种应用的基础而受到广泛关注。但不规则的点云数据无法直接作为传统卷积神经网络的输入,而图卷积神经网络可以利用图卷积算子直接对点云数据进行特征提取,使得图卷积神经网络已逐步成为点云语义分割领域的一个重要研究方向。基于此,对图卷积神经网络在3D点云语义分割应用中的研究进展进行综述,根据图卷积的类型对基于图卷积神经网络的点云语义分割方法进行分类,按照不同类别对比分析主流方法的模型架构及其特点,描述几个相关点云语义分割领域常用的公共数据集和评价指标,对点云语义分割方法进行总结和展望。

关键词: 语义分割, 3D点云, 图卷积神经网络, 深度学习