FROM MOTION TO EMOTION: A WEARABLE SYSTEM FOR THE MULTIMEDIA ENRICHMENT OF A BUTOH DANCE PERFORMANCE

Abstract

We present a mobile, multimedia system based on a network of body worn motion sensors, a wearable computer and a visualization engine that is used to produce a visual enhancement of Butoh dance performance. The core of the system is a novel motion classification scheme that allows us to capture the emotion expressed by the dancer during the performance and map it onto scripted visual effects. We describe the artistic concept behind the multimedia enhancement, the motion classification scheme and the system architecture. In an experimental evaluation we investigate the usefulness and the robustness of the wearable computer as well as the classification accuracy of the motion-sensing system. We also summarize the experiences with using the system for live performances on stage in several shows.