Interactive mobile music performance system with digital compass

Abstract

This thesis introduces an interactive mobile music performance system using the digital compass of mobile phones. Compass-based interface can detect the aiming orientation of performers on stage, allowing us to obtain information on interactions between performers and use it for both musical mappings and visualizations on screen for the audience. In addition to aiming direction, an algorithm for a new app to track down the performer’s position in real time is presented. By tracing the positions of moving performers with compass, a variety of real-time musical mapping strategies with the information on performers’ positions can be designed. Various types of mapping strategies using virtual instrument and sound synthesis engine are adapted to each interaction method. After describing each performance and interaction concept, the result of a compass-based mobile music performance series, Where Are You Standing? is documented and discussed.