VR Interactive 3D Virtual Crane Modeling and Simulation

doi:10.3778/j.issn.1002-8331.2211-0173

Abstract

Abstract: Crane, as a widely used special equipment, is highly dangerous in operation and prone to safety accidents. In order to reduce the safety accidents caused by improper operation, the state attaches great importance to the crane safety training. The current training operations are mostly traditional demonstration training with high training costs and poor results. Virtual reality technology has the advantages of immersion, interaction and multi-perception and so on. Based on this, this study uses virtual reality technology to establish crane training and assessment system, which have greatly improved the effect of worker training. In order to restore the true use scene of the crane, first of all, reverse engineering technology is used to model the crane and crane workshop. Secondly, in view of the reality of 3D virtual scene and the poor reusability of interactive models with a large number of models, the level of detail (LOD) model is used to build the geometric model of crane, so as to optimize the realism and real-time of the system. Then, 3D scene roaming, collision detection and fast navigation of crane are realized with Unity platform. Based on MySQL database, the training data and crane important parameters data are storage in real-time. Finally, the virtual platform is validated according to the existing bridge platform. The results show that the crane virtual reality training system can greatly improve the sensory training while reducing the training cost, and the experiment has a better effect.

Key words: virtual reality, crane training, reverse engineering, level of detail (LOD) model, Unity

摘要： 起重机作为广泛应用的特种装备，运行危险性大，极易发生安全事故。为降低由操作不当引起的安全事故，国家高度重视起重机的安全培训工作。目前培训操作多为传统的示教式培训，培训成本高、效果差。虚拟现实技术具有沉浸式、交互性、多感知等优点。基于此，采用虚拟现实技术建立起重装备培训和考核系统，大幅提升工人培训效果。为还原起重机真实使用场景，采用逆向工程技术对起重机及起重机厂房进行建模；针对三维虚拟场景真实性以及模型数量巨大交互模型复用性差的问题，采用细节层次（levels of detail，LOD）模型构建起重装备几何模型，从而优化系统的真实感和实时性；利用Unity平台实现了起重装备的三维场景漫游、碰撞检测和快速导航；基于MySQL数据库，实时存储培训数据以及起重机重要参数数据；依据现有桥机平台对虚拟平台进行了验证，结果显示该起重机虚拟现实培训系统可以在降低培训成本的同时大幅提升了培训感官，实验效果良好。

关键词: 虚拟现实, 起重装备培训, 逆向工程, 细节层次（LOD）模型, Unity

HUANG Kaige, HUI Yanbo, LIU Yonggang, WANG Hongxiao, WANG Qiao. VR Interactive 3D Virtual Crane Modeling and Simulation[J]. Computer Engineering and Applications, 2024, 60(7): 204-211.

黄凯歌, 惠延波, 刘永刚, 王宏晓, 王瞧. VR交互式三维虚拟起重装备建模与仿真[J]. 计算机工程与应用, 2024, 60(7): 204-211.

References

[1] 顾君忠. VR、AR和MR-挑战与机遇[J]. 计算机应用与软件, 2018, 35(3): 1-7.
GU J Z. VR, AR and MR-challenges and opportunities[J]. Computer Applications and Software, 2018, 35(3): 1-7.
[2] SONG H, KIM T, KIM J, et al. Effectiveness of VR crane training with head-mounted display: double mediation of presence and perceived usefulness[J]. Automation in Construction, 2021, 122: 103506.
[3] CHU Y, HATLEDAL L I, ZHANG H, et al. Virtual prototyping for maritime crane design and operations[J]. Journal of Marine Science and Technology, 2018, 23(4): 754-766.
[4] CHECA C D, MARTINEZ K, OSORNIO R, et al. Virtual reality opportunities in the reduction of occupational hazards in Industry 4.0[J]. Dyna, 2021, 96(6): 620-626.
[5] 张文胜, 岳康. 基于VR的驾驶仿真及安全教育系统开发[J]. 计算机工程与应用, 2022, 58(23): 278-284.
ZHANG W S, YUE K. Development of driving simulation and safety education system based on VR[J]. Computer Engineering and Applications, 2022, 58(23): 278-284.
[6] 李婷婷, 王相海. 基于AR-VR混合技术的儿童智力开发系统研究[J]. 计算机工程与应用, 2020, 56(23): 259-264.
LI T T, WANG X H. Research on children’s intelligence development system based on AR-VR hybrid technology[J]. Computer Engineering and Applications, 2020, 56(23): 259-264.
[7] 赵美成, 乔金林, 冯孟奇. VR技术在煤矿应急救援培训中的应用研究[J]. 工矿自动化, 2021, 47(S2): 155-158.
ZHAO M C, QIAO J L, FENG M Q. Application research of VR technology in coal mine emergency rescue training[J]. Industry and Mine Automation, 2021, 47(S2): 155-158.
[8] 杨晓, 任鸿翔, 廉静静, 等. VR交互式三维虚拟船舶建模与仿真[J]. 中国航海, 2022, 45(1): 37-42.
YANG X, REN H X, LIAN J J, et al. 3D virtual ship construction and simulation through VR interactive technology[J]. Navigation of China, 2022, 45(1): 37-42.
[9] 曹旭阳, 董胜豪, 孙健. 基于VR的无人车间桥式起重机路径规划研究[J]. 起重运输机械, 2021(1): 34-39.
CAO X Y, DONG S H, SUN J. Research on VR-based route planning of unmanned workshop bridge crane[J]. Hoisting and Conveying Machinery, 2021(1): 34-39.
[10] 王虎, 郝圣旺, 张海清, 等. 基于逆向建模技术的金属矿山空区探测与治理研究[J]. 金属矿山, 2020(7): 59-65.
WANG H, HAO S W, ZHANG H Q, et al. Study on the goaf detection and goverance of metal mines based on reverse modeling technique[J]. Metal Mine, 2020(7): 59-65.
[11] 陈超, 郑攀, 李猛猛, 等. 船用螺旋桨的逆向建模研究[J]. 机械设计与制造, 2020(9): 271-275.
CHEN C, ZHENG P, LI M M, et al. Research on reverse modeling of marine propeller[J]. Machinery Design ＆ Manufacture, 2020(9): 271-275.
[12] 陈艳雷. 基于逆向工程的扫描点云数据预处理技术研究[D]. 郑州: 河南工业大学, 2018.
CHEN Y L. Research on scan point clouds data preprocessing techniques based on reverse engineering[D]. Zhengzhou: Henan University of Technology, 2018.
[13] 祁甲民, 冯兰芳, 陈艳雷, 等. 逆向工程中三维建模模型纹理贴图方法探究[J]. 制造业自动化, 2018, 40(5): 112-114.
QI J M, FENG L F, CHEN Y L, et al. Exploration of texture mapping methods for 3D modeling models in reverse engineering[J]. Manufacturing Automation, 2018, 40(5): 112-114.
[14] 谢忠良, 李铁瑞. 复杂自由曲面的离散化网格划分方法[J]. 空间结构, 2021, 27(2): 19-23.
XIE Z L, LI T R. Discrete meshing method for complex free-form surface[J]. Spatial Structures, 2021, 27(2): 19-23.
[15] 王庆国, 丁卫东, 朱晓宏, 等. 误差受控的多细节层次地形模型的实现[J]. 测绘通报, 2009(12): 27-30.
WANG Q G, DING W D, ZHU X H, et al. Implementation of error-controlled multi-detail level terrain model[J]. Bulletin of Surveying and Mapping, 2009(12): 27-30.
[16] 李宗琼. 三维模型重构技术的研究及模型库的设计与实现[D]. 绵阳: 西南科技大学, 2016.
LI Z Q. Research on 3D model reconstruction technique and the design and implementation of model base[D]. Mianyang: Southwest University of Science and Technology, 2016.