Musical Applications of Electromagnetic Field Sensing

Abstract This article describes a series of experiments and techniques for audiovisual performance composition using electromagnetic waves. These experiments represent the consecutive steps that led to the development of REBUS, a novel musical machine and interactive system that can be used to explore and expand upon contactless interaction techniques. Drawing on previous experience in designing simple synthesizers to transform light into sound, compositional systems that use invisible frequencies of the electromagnetic field were explored as both sonic material and interactive interfaces. A review and comparison of other sensing techniques is followed by a description of the potential of electromagnetic field sensing. Implementing state-of-the-art technology and using previously unexplored frequencies, REBUS is a novel digital computational instrument that creates a space where any subtle interaction is detected independently of external light or sound and where invisible affordances can be touched and manipulated with the hands and the body—almost as invisible strings.