Quantifying Motor and Cognitive Function of the Upper Limb Using Mixed Reality Smartglasses

In our aging world, the need to measure and evaluate motor and cognitive functions and to automate physical and occupational therapy will increase in the future. Many studies on VR-based rehabilitation systems are already underway. However, there are some issues such as the risk of falling or crashing due to the complete blockage of visual information, VR sickness, and lack of reality. The purpose of this research is to develop a system that simultaneously measures and evaluates multiple abilities and functions, such as motor function, cognitive function, and prediction ability, by using mixed reality (MR) smartglasses technology that enables interaction with spatially arranged objects while maintaining real-world information. In this study, we focused on the motor function of the upper limbs and cognitive function, and measured finger and gaze movements during a reaching task. In addition, we developed a game-based task for occupational therapy in a MR environment and reported the results.