Abstract: Since augmented reality technology has the features of real-time interaction with the userand the high degree of integration of the “virtual and real”, it has been applied into various fields rapidly. However, such technology is rarely used into the stage performance field, because it is difficult for actors to interact with display system in real time. Stage performance effects are usually obtained through video display, the actors need accurately match the video content in order to achieve the desired artistic effect, this seriously constrains the actor’s performance. To solve the problem, this paper proposes a real-time interactive system based on infrared camera. The system shows the corresponding rendering image according to the action of the actors in real-time, which completely liberates the shackles of the actors and coordinates the man-machine relationship of the actor and display system, making the stage effect determined by the actors rather than by the video passively. The system has been successfully applied to a number of formal performances of the stage play and provides a new idea for the stage interactive method.

Key words: augmented reality, infrared image, real-time interaction, particle system, texture fusion

摘要： 增强现实技术以其与用户实时交互及“虚实”高度融合的特点在各个领域都得到了迅猛发展，但在舞台艺术中的研究与应用尚少，其难点便在于演员与显示系统难以实时交互。传统舞台特效多通过视频播放获得，演员需精准配合视频，严重限制了其发挥。针对该问题，提出了一种基于红外摄像头的舞台增强现实系统，根据现场演员的舞蹈动作实时驱动特效并呈现相应的合成画面，完全解放了演员的束缚，协调了其与显示系统的人机关系，使得舞台效果的呈现由演员自主确定，而不是被动地配合视频。该系统成功应用于多个正式演出的舞台剧中，为新型的舞台互动方法提供了一种新思路。

关键词: 增强现实, 红外图像, 实时互动, 粒子系统, 纹理融合