YOUPLAY: DESIGNING PARTICIPATORY THEATRICAL PERFORMANCE USING WEARABLE TECHNOLOGIES
Keywords:
Interactive, Performance, Sensing Technology, Theater ArtsAbstract
This paper describes a participatory theatrical performance named YOUPLAY. In YOU- PLAY, a general person who is usually treated as an audience member becomes an actor and plays a character role in the performance. He/she wears several types of equipments such as sensors and a microphone, and experiences an interactive story. While our sys- tem presents various interactive stage effects using wearable sensors, these devices raise hardware/software troubles. We found during the development and actual use of the system that such interactive systems need robust activity recognition techniques. We explain the details of the system for YOUPLAY and present the knowledge gathered from 80 actual stages. Additionally, we discuss the general design for interactive system with the results of questionnaires that are gathered from participants of our system, the occurrence of the troubles, and the way to deal with them.
Downloads
References
S. Dow, M. Mehta, E. Harmon, B. MacIntyre, and M. Mateas (2007), Presence and engagement
in an Interactive Drama, Proc. of the 25th SIGCHI conference on Human Factors in Computing
Systems (CHI 2007), pp. 1475–1484.
J. G. Sheridan, N. Bryan-Kinns, and Alice Bayliss (2007), Encouraging Witting Participation and
Performance in Digital Live Art, Proc. of the 21st British HCI Group Annual Conference on
People and Computers: HCI (BCS-HCI 2007), pp. 13–23.
G. Jacucci, M. Wagner, I. Wagner, and E. Giaccardi (2010), ParticipArt: Exploring Participa-
tion in Interactive Art Installations, Proc. of the 9th International Symposium on Mixed and
Augmented Reality (ISMAR 2010), pp. 3–10.
P. Dalsgaard, C. Dindler, and K. Halskov (2011), Understanding the Dynamics of Engaging In-
teraction in Public Spaces, Human-Computer Interaction – INTERACT 2011, pp. 212–229.
C. B. Owen, A. Dobbins, and L. Rebenitsch (2013), Theatre Engine: Integrating Mobile Devices
with Live Theater, Proc. of the 11th International Conference on Advances in Mobile Computing
& Multimedia (MoMM 2013), pp. 3–10.
H. Y. Nam and M. Nitsche (2014), Interactive Installations as Performance: Inspiration for HCI,
Proc. of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI
, pp. 189–196.
S. Webber, M. Harrop, J. Downs, T. Cox, N. Wouters, and A. V. Moere (2015), Everybody Dance
Now: Tensions between Participation and Performance in Interactive Public Installations, Proc.
of the 27th Annual Meeting of the Australian Special Interest Group for Computer Human Inter-
action (OzCHI 2015), pp. 284–288.
H. Ishii, C. Wisneski, J. Orbanes, B. Chun, and J. Paradiso (1999), PingPongPlus: Design of an
Athletic-tangible Interface for Computer-supported Cooperative Play, Proc. of the 17th SIGCHI
conference on Human Factors in Computing Systems (CHI 1999), pp. 394–401.
Y. Okuno, H. Kakuta, and T. Takayama (2003), Jellyfish Party: Blowing Soap Bubbles in Mixed
Reality Space, Proc. of the 2nd International Symposium on Mixed and Augmented Reality (IS-
MAR 2003), pp. 358–359.
M. Katsura and M. Inakage (2006), livePic, Proc. of the 33th International Conference and Exhi-
bition on Computer Graphics and Interactive Techniques (SIGGRAPH 2006).
D. Iwai and K. Sato (2005), Heat Sensation in Image Creation with Thermal Vision, Proc. of the
nd International Conference on Advances in Computer Entertainment Technology (ACE 2005),
pp. 213–216.
Y. Takegawa, K. Fukushi, T. Machover, T. Terada, and M. Tsukamoto (2012), Construction of
a Prototyping Support System for Painted Musical Instruments, Proc. of the 9th Advances in
Computer Entertainment Conference (ACE 2012), pp. 384–397.
A. Crabtree, S. Benford, T. Rodden, C. Greenhalgh, M. Flintham, R. Anastasi, A. Drozd, M.
Adams, J. Row-Farr, N. Tandavanitj, and A. Steed (2004), Orchestrating a Mixed Reality Game
‘On the Ground’, Proc. of the 22th SIGCHI conference on Human Factors in Computing Systems
(CHI 2004), pp. 391–398.
L. Oppermann, M. Flintham, S. Reeves, S. Benford, C. Greenhalgh, J. Marshall, M. Adams, J.
Row-Farr, and N. Tandavanitj (2011), Lessons from Touring a Location-based Experience, Proc.
of the 9th international conference on Pervasive computing (Pervasive 2011), pp. 232–249.
L. Fosh, S. Benford, S. Reeves, B. Koleva, and P. Brundell (2013), See Me, Feel Me, Touch
Me, Hear Me: Trajectories and Interpretation in a Sculpture Garden, Proc. of the 31th SIGCHI
conference on Human Factors in Computing Systems (CHI 2013), pp. 149–158.
N. Isoyama, T. Terada, and M. Tsukamoto (2013), An Interactive Surface that Recognizes User
Actions using Accelerometers, Proc. of the 12th NICOGRAPH International 2013, pp. 72–80.
F. Sparacino, G. Davenport, and A. Pentland (2000), Media in Performance: Interactive Spaces
for Dance, Theater, Circus, and Museum Exhibits, IBM Systems Journal, Vol. 39, Nos. 3 & 4, pp.
–510.
messa di voce: http://www.tmema.org/messa/messa.html.
M. Fujimoto, N. Fujita, Y. Takegawa, T. Terada, and M. Tsukamoto (2009), A Motion Recognition
Method for a Wearable Dancing Musical Instrument, Proc. of the 13th International Symposium
on Wearable Computers (ISWC 2009), pp. 11–18.
H. Kanke, Y.Takegawa, T. Terada, and M. Tsukamoto (2012), Airstic Drum: a Drumstick for
Integration of Real and Virtual Drums, Proc. of the 9th Advances in Computer Entertainment
Conference (ACE 2012), pp. 57–69.
S. Hirasawa: Interactive Live: http://noroom.susumuhirasawa.com/modules/artist/interactive-
live.html.
SYNK: http://hexler.net/software/synk.
DROW: http://drow.jp/.
rhizomatiks: works: http://rhizomatiks.com/works/.
NxPC.Lab: http://nxpclab.info/.
M. Hirabayashi and M. Shimizu (2012), Cryptone: interaction between performers and audiences
with inaudible DTMF sounds, Proc. of SIGGRAPH Asia 2012 Emerging Technologies, No. 5, pp.
–4.
D. Maynes-Aminzade, R. Pausch, and S. Seitz (2002), Techniques for Interactive Audience Par-
ticipation, Proc. of the 4th IEEE International Conference on Multimodal Interfaces (ICMI 2002),
pp. 15–20.
Aphex Twin Face Mapping at London Electronic Festival:
https://www.youtube.com/watch?v=rGosqmf-740.
T. Cerratto-Pargman, C. Rossitto, and L. Barkhuus (2014), Understanding Audience Participation
in an Interactive Theater Performance, Proc. of the 8th Nordic Conference on Human-Computer
Interaction (NordiCHI 2014), pp. 608–617.
A. Wiethoff, J. Gerstberger, and S. Gehring (2015), StarLight - Exploring Embodied Interactions
with Media Architecture and Public Audiences, Proc. of the 4th International Symposium on
Pervasive Displays (PerDis 2015), pp. 83–89.
G. Friederichs-Buttner, B. Walther-Franks, and R. Malaka (2012), An Unfinished Drama: De-
signing Participation for the Theatrical Dance Performance Parcival XX-XI, Proc. of the 9th
Designing Interactive Systems Conference (DIS 2012), pp. 770–778.
Xylobands: http://www.xylobands.com/.
Pixmob: http://pixmob.com/.
niconico LIVE: http://live.nicovideo.jp/.
Showroom: https://www.showroom-live.com/.
T. Yonezawa and H. Tokuda (2012), Enhancing Communication and Dramatic Impact of On-
line Live Performance with Cooperative Audience Control, Proc. of the 14th ACM international
Conference Adjunct Papers on Ubiquitous Computing (Ubicomp 2012), pp. 103–112.
A. Moreno, R. V. Delden, R. Poppe, and D. Reidsma (2013), Socially Aware Interactive Play-
grounds, IEEE Pervasive Computing, Vol. 12, Issue 3, pp. 40–47.
R. Poppe, R. V. Delden, A. Moreno, and D. Reidsma (2014), Interactive Playgrounds for Children,
Playful User Interfaces, pp. 99–118.
YOUPLAY: http://www.hephall.com/youplay/vol1/index.html.
R. Izuta, K. Murao, T. Terada, and M. Tsukamoto (2015), Early Gesture Recognition Method with
an Accelerometer, International Journal of Pervasive Computing and Communications, Vol. 11,
Issue 3, pp. 270–287.
sunday: http://sunday-go.jp/.
Patch: http://www.west-patch.com/.
M. Honauer and E. Hornecker (2015), Challenges for Creating and Staging Interactive Costumes
for the Theatre Stage, Proc. of the 6th ACM SIGCHI conference on Creativity & Cognition (C&C
, pp. 13–22.
