Development of a VR Training System for Saito's Music Conducting Method

It is important for university students studying elementary music education to master basic conducting gestures. We have developed a VR training system for self‐study of Saito's music conducting method. The system uses a depth camera and magnetic motion capture system to measure hand movements, and an HMD to superimpose the teacher's hand on the trainee's own hand. With the system, trainee can self‐study while visually and three‐dimensionally checking the motion and timing of the teacher's and the trainee's own hand gestures. In this paper, we describe an evaluation experiment with our system. The results showed that the VR environment is effective for learning three‐dimensional movements, and that the addition of a visual line display function for trajectories, a function to display trajectories from different viewpoints, and a replay function improves the learning effect. Specifically, the results of a short training session of 5 min revealed that the developed system was effective in bringing 75% of the trainees closer to the teacher's gesture. © 2023 Institute of Electrical Engineer of Japan and Wiley Periodicals LLC.