A COMPARISON OF TECHNIQUES FOR CROSS-DEVICE INTERACTION FROM MOBILE DEVICES TO LARGE DISPLAYS
Keywords:
Cross-Device Interaction, mobile devices, large displays, Interaction Techniques, Kinect, Mid-air GesturesAbstract
In recent years there has been an increasing interest in cross-device interaction research involving mobile computing. We contribute to this research with a comparative study of four interaction techniques for moving information from a mobile device to a large display. The four techniques (Pinch, Swipe, Throw, and Tilt) were compared through a laboratory experiment with 53 participants, measuring their effectiveness, efficiency and error size. Findings from the experiment revealed that the Swipe technique performed best on all measures. In terms of effectiveness, the Tilt technique performed the worst, and especially so with small targets. In terms of efficiency and error size, the Pinch technique was the slowest and also the most imprecise. We also found that target size mattered considerably for all techniques, confirming previous research. Based on our findings we discuss why the individual techniques performed as observed, and discuss implications for using mobile devices in cross-device interaction design.
Downloads
References
Benko, H. and Wilson, A.D., Multi-point interactions with immersive omnidirectional
visualizations in a dome. in ITS '10: ACM International Conference on Interactive Tabletops and
Surfaces, (2010), 19-28.
Boring, S., Altendorfer, M., Broll, G., Hilliges, O. and Butz, A., Shoot & copy: phonecam-based
information transfer from public displays onto mobile phones. in Mobility '07: 4th international
conference on mobile technology, applications, and systems and the 1st international symposium
on Computer human interaction in mobile technology, (2007), 24-31.
Boring, S., Jurmu, M., and Butz, A., Scroll, tilt or move it: using mobile phones to continuously
control pointers on large public displays. in OZCHI '09: 21st Annual Conference of the Australian
Computer-Human Interaction Special Interest Group, (2009), 161-168.
Bragdon, A., DeLine, R., Hinckley, R. and Morris, M.R., Code space: touch + air gesture hybrid
interactions for supporting developer meetings. in ITS '11: ACM International Conference on
Interactive Tabletops and Surfaces, (2011), 212-221.
Chen, X., Grossman, T., Wigdor, D.J. and Fitzmaurice, G., Duet: exploring joint interactions on a
smart phone and a smart watch. in CHI '14: SIGCHI Conference on Human Factors in Computing
Systems, (2014), 159-168.
Dachselt, R. and Buchholz, R., Natural throw and tilt interaction between mobile phones and
distant displays. in CHI '09 EA: CHI 2009 Extended Abstracts on Human Factors in Computing
Systems, (2009), 3253-3258.
Hamilton, P. and Wigdor, D.J., Conductor: enabling and understanding cross-device interaction.
in CHI '14: SIGCHI Conference on Human Factors in Computing Systems, (2014), 2773-2782.
Hincapié-Ramos, J.D., Guo, X., Moghadasian, P., Irani, P., Consumed endurance: a metric to
quatify arm fatique of mid-air interactions. in CHI '14: Proceedings of the SIGCHI Conference on
Human Factors in Computing Systems, (2014), 1063-1072.
Hoaglin, D.C., Iglewicz, B. and Tukey, J.W. Performance of some resistant rules for outlier
labeling. Journal of the American Statistical Association, 81(396), 1986. 991-999.
Ikematsu, K. and Siio, I., Memory Stones: An Intuitive Information Transfer Technique between
Multi-touch Computers. in HotMobile '15: 16th International Workshop on Mobile Computing
Systems and Applications, (2015), 3-8.
Jokela, T., Ojala, J. and Olsson, T., A Diary Study on Combining Multiple Information Devices in
Everyday Activities and Tasks. in CHI '15: 33rd Annual ACM Conference on Human Factors in
Computing Systems, (2015), 3903-3912.
Lucero, A., Holopainen, J. and Jokela, T., MobiComics: collaborative use of mobile phones and
large displays for public expression. in MobileHCI '12: 14th international conference on Humancomputer
interaction with mobile devices and services, (2012), 383-392.
Lund, A.M., Measuring Usability with the USE Questionnaire. STC Usability SIG Newsletter,
(2001).
Marquardt, N., Hinckley, K. and Greenberg, S., Cross-device interaction via micro-mobility and fformations.
in UIST '12: 25th annual ACM symposium on User interface software and
technology, (2012), 13-22.
Myers, B.A., Using handhelds and PCs together. Communications of the ACM, 44 (11), 2001. 34-
Nielsen, H.S., Olsen, M.P., Skov, M.B. and Kjeldskov, J., JuxtaPinch: exploring multi-device
interaction in collocated photo sharing. in MobileHCI '14: 16th international conference on
Human-computer interaction with mobile devices & services, (2014), 183-192.
Rekimoto, J., Pick-and-drop: a direct manipulation technique for multiple computer environments.
in UIST '97: 10th annual ACM symposium on User interface software and technology, (1997), 31-
Rekimoto, J., Multiple-Computer User Interfaces: A cooperative environment consisting of
multiple digital devices. in CoBuild '98: First International Workshop on Cooperative Buildings,
Integrating Information, Organization, and Architecture, (1998), 33-40.
Rädle, R., Jetter, H., Schreiner, M., Lu, Z., Reiterer, H. and Rogers, Y., Spatially-aware or
Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions. in CHI
'15: 33rd Annual ACM Conference on Human Factors in Computing Systems, (2015), 3913-3922.
Raptis, D., Tselios, N., Kjeldskov, J. and Skov. M.B., Does size matter?: investigating the impact
of mobile phone screen size on users' perceived usability, effectiveness and efficiency. in
MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction
with mobile devices and services, (2013), 127-136.
Scheible, J., Ojala, T. and Coulton, P., MobiToss: a novel gesture based interface for creating and
sharing mobile multimedia art on large public displays. in MM '08: 16th ACM international
conference on Multimedia, (2008), 957-960.
Schmidt, D., Chehimi, F., Rukzio, E. and Gellersen, H., PhoneTouch: a technique for direct phone
interaction on surfaces. in UIST '10: 23rd annual ACM symposium on User interface software and
technology, (2010), 13-16.
Schmidt, D., Seifert, J., Rukzio, E. and Gellersen, H., A cross-device interaction style for mobiles
and surfaces. in DIS '12: Designing Interactive Systems Conference, (2012), 318-327.
Skov, M.B., Kjeldskov, J., Paay, J., Jensen, H.P. and Olsen, M.P., Investigating Cross-Device
Interaction Techniques: A Case of Card Playing on Handhelds and Tablets. in OzCHI '15: Annual
Meeting of the Australian Special Interest Group for Computer Human Interaction, (2015), 446-
Sørensen, H., Raptis, D., Kjeldskov, J. and Skov, M.B., The 4C framework: principles of
interaction in digital ecosystems. in UbiComp '14: 2014 ACM International Joint Conference on
Pervasive and Ubiquitous Computing, (2014), 87-97.
Walter, R., Bailly, G., Valkanova, N. and Müller, J., Cuenesics: Using Mid-air Gestures to Select
Items on Interactive Public Displays. in MobileHCI '14: 16th international conference on Humancomputer
interaction with mobile devices & services, (2014), 299–308.
