Abstract:

Picture book reading and video watching are commonly used on children’s intelligence development, which lack in variability on expression, vividness, interaction quality, etc. An game-like children’s intelligence development system is developed in this project, theoretically based on intelligence development theories, and technically based on Unity 3D and hybrid AR-VR technology. VR technology is used to develop virtual roaming module, which can cultivate children’s cognitive and observation ability through immersive interactive experience. Besides, AR technology is also used to develop map recognition module, which can deliver richer and more specific learning experience for children through 3D learning mode. The result shows that highly virtual study scenarios based on hybrid AR-VR technology stimulates children’s perception and interaction with real scenarios. Compared with traditional approaches to children’s intelligence development, children’s intelligence can be reasonably developed by better study experience and interaction with the help of this system.

Key words: virtual reality, augmented reality, children’s intellectual development, human computer interaction, multi-sensory experience

摘要：

传统的儿童智力开发大多采用观看图书或是视频的方式，存在信息表达单一、缺乏生动性、交互性差等缺陷。在儿童智力开发理论基础上，将增强现实技术（AR）与虚拟现实技术（VR）结合，基于Unity3D平台设计，开发出具有游戏式风格的儿童智力开发系统。VR技术用于开发虚拟漫游模块，通过沉浸式交互体验，培养儿童对身边事物的认知及观察能力。AR技术用于开发识图模块，通过3D的学习方式，为儿童传递更丰富更具体的学习体验。实验结果表明，AR-VR混合技术能构建出高度真实的学习环境，具有多感官交互效果，增强儿童对现实环境的感知和学习能力，相较于传统的儿童智力开发，该系统能帮助儿童获得更好的学习体验和交互方式，激发儿童的学习兴趣。

关键词: 虚拟现实, 增强现实, 儿童智力开发, 人机交互, 多感官体验