Virtual reality, working memory and sensory fidelity: A study of 3D avatars versus 2D video interfaces

Much remains unknown about how virtual reality (VR) environments affect working memory (WM), i.e. the retention of a small amount of information in a readily accessible form. While WM is associated with one's information processing capabilities, executive function, comprehension and problem solving – parameters vital for one to act in a VR environment – it is unclear whether it is affected when information is conveyed through virtual interfaces. In this study, using 106 participants, we examine whether WM in a virtual environment is affected when a 3D avatar or 2D video interface delivers verbal or spatial information, or a combination of the two types. The results did not show statistically significant differences between the two conditions for verbal or spatial tasks. However, a non-significant trend was observed in tasks engaging the central executive, suggesting a potential interface-related effect worth further exploration. These findings highlight the importance of future research on multimodal interface design in VR.