A COMPARISON OF TECHNIQUES FOR CROSS-DEVICE INTERACTION FROM MOBILE DEVICES TO LARGE DISPLAYS

Authors

  • JENI PAAY Department of Computer Science, Aalborg University, Denmark
  • DIMITRIOS RAPTIS Department of Computer Science, Aalborg University, Denmark
  • JESPER KJELDSKOV Department of Computer Science, Aalborg University, Denmark
  • BJARKE M. LAURIDSEN Department of Computer Science, Aalborg University, Denmark
  • IVAN S. PENCHEV Department of Computer Science, Aalborg University, Denmark
  • ELIAS RINGHAUGE Department of Computer Science, Aalborg University, Denmark
  • ERIC V. RUDER Department of Computer Science, Aalborg University, Denmark

Keywords:

Cross-Device Interaction, mobile devices, large displays, Interaction Techniques, Kinect, Mid-air Gestures

Abstract

In recent years there has been an increasing interest in cross-device interaction research involving mobile computing. We contribute to this research with a comparative study of four interaction techniques for moving information from a mobile device to a large display. The four techniques (Pinch, Swipe, Throw, and Tilt) were compared through a laboratory experiment with 53 participants, measuring their effectiveness, efficiency and error size. Findings from the experiment revealed that the Swipe technique performed best on all measures. In terms of effectiveness, the Tilt technique performed the worst, and especially so with small targets. In terms of efficiency and error size, the Pinch technique was the slowest and also the most imprecise. We also found that target size mattered considerably for all techniques, confirming previous research. Based on our findings we discuss why the individual techniques performed as observed, and discuss implications for using mobile devices in cross-device interaction design.

 

Downloads

Download data is not yet available.

References

Benko, H. and Wilson, A.D., Multi-point interactions with immersive omnidirectional

visualizations in a dome. in ITS '10: ACM International Conference on Interactive Tabletops and

Surfaces, (2010), 19-28.

Boring, S., Altendorfer, M., Broll, G., Hilliges, O. and Butz, A., Shoot & copy: phonecam-based

information transfer from public displays onto mobile phones. in Mobility '07: 4th international

conference on mobile technology, applications, and systems and the 1st international symposium

on Computer human interaction in mobile technology, (2007), 24-31.

Boring, S., Jurmu, M., and Butz, A., Scroll, tilt or move it: using mobile phones to continuously

control pointers on large public displays. in OZCHI '09: 21st Annual Conference of the Australian

Computer-Human Interaction Special Interest Group, (2009), 161-168.

Bragdon, A., DeLine, R., Hinckley, R. and Morris, M.R., Code space: touch + air gesture hybrid

interactions for supporting developer meetings. in ITS '11: ACM International Conference on

Interactive Tabletops and Surfaces, (2011), 212-221.

Chen, X., Grossman, T., Wigdor, D.J. and Fitzmaurice, G., Duet: exploring joint interactions on a

smart phone and a smart watch. in CHI '14: SIGCHI Conference on Human Factors in Computing

Systems, (2014), 159-168.

Dachselt, R. and Buchholz, R., Natural throw and tilt interaction between mobile phones and

distant displays. in CHI '09 EA: CHI 2009 Extended Abstracts on Human Factors in Computing

Systems, (2009), 3253-3258.

Hamilton, P. and Wigdor, D.J., Conductor: enabling and understanding cross-device interaction.

in CHI '14: SIGCHI Conference on Human Factors in Computing Systems, (2014), 2773-2782.

Hincapié-Ramos, J.D., Guo, X., Moghadasian, P., Irani, P., Consumed endurance: a metric to

quatify arm fatique of mid-air interactions. in CHI '14: Proceedings of the SIGCHI Conference on

Human Factors in Computing Systems, (2014), 1063-1072.

Hoaglin, D.C., Iglewicz, B. and Tukey, J.W. Performance of some resistant rules for outlier

labeling. Journal of the American Statistical Association, 81(396), 1986. 991-999.

Ikematsu, K. and Siio, I., Memory Stones: An Intuitive Information Transfer Technique between

Multi-touch Computers. in HotMobile '15: 16th International Workshop on Mobile Computing

Systems and Applications, (2015), 3-8.

Jokela, T., Ojala, J. and Olsson, T., A Diary Study on Combining Multiple Information Devices in

Everyday Activities and Tasks. in CHI '15: 33rd Annual ACM Conference on Human Factors in

Computing Systems, (2015), 3903-3912.

Lucero, A., Holopainen, J. and Jokela, T., MobiComics: collaborative use of mobile phones and

large displays for public expression. in MobileHCI '12: 14th international conference on Humancomputer

interaction with mobile devices and services, (2012), 383-392.

Lund, A.M., Measuring Usability with the USE Questionnaire. STC Usability SIG Newsletter,

(2001).

Marquardt, N., Hinckley, K. and Greenberg, S., Cross-device interaction via micro-mobility and fformations.

in UIST '12: 25th annual ACM symposium on User interface software and

technology, (2012), 13-22.

Myers, B.A., Using handhelds and PCs together. Communications of the ACM, 44 (11), 2001. 34-

Nielsen, H.S., Olsen, M.P., Skov, M.B. and Kjeldskov, J., JuxtaPinch: exploring multi-device

interaction in collocated photo sharing. in MobileHCI '14: 16th international conference on

Human-computer interaction with mobile devices & services, (2014), 183-192.

Rekimoto, J., Pick-and-drop: a direct manipulation technique for multiple computer environments.

in UIST '97: 10th annual ACM symposium on User interface software and technology, (1997), 31-

Rekimoto, J., Multiple-Computer User Interfaces: A cooperative environment consisting of

multiple digital devices. in CoBuild '98: First International Workshop on Cooperative Buildings,

Integrating Information, Organization, and Architecture, (1998), 33-40.

Rädle, R., Jetter, H., Schreiner, M., Lu, Z., Reiterer, H. and Rogers, Y., Spatially-aware or

Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions. in CHI

'15: 33rd Annual ACM Conference on Human Factors in Computing Systems, (2015), 3913-3922.

Raptis, D., Tselios, N., Kjeldskov, J. and Skov. M.B., Does size matter?: investigating the impact

of mobile phone screen size on users' perceived usability, effectiveness and efficiency. in

MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction

with mobile devices and services, (2013), 127-136.

Scheible, J., Ojala, T. and Coulton, P., MobiToss: a novel gesture based interface for creating and

sharing mobile multimedia art on large public displays. in MM '08: 16th ACM international

conference on Multimedia, (2008), 957-960.

Schmidt, D., Chehimi, F., Rukzio, E. and Gellersen, H., PhoneTouch: a technique for direct phone

interaction on surfaces. in UIST '10: 23rd annual ACM symposium on User interface software and

technology, (2010), 13-16.

Schmidt, D., Seifert, J., Rukzio, E. and Gellersen, H., A cross-device interaction style for mobiles

and surfaces. in DIS '12: Designing Interactive Systems Conference, (2012), 318-327.

Skov, M.B., Kjeldskov, J., Paay, J., Jensen, H.P. and Olsen, M.P., Investigating Cross-Device

Interaction Techniques: A Case of Card Playing on Handhelds and Tablets. in OzCHI '15: Annual

Meeting of the Australian Special Interest Group for Computer Human Interaction, (2015), 446-

Sørensen, H., Raptis, D., Kjeldskov, J. and Skov, M.B., The 4C framework: principles of

interaction in digital ecosystems. in UbiComp '14: 2014 ACM International Joint Conference on

Pervasive and Ubiquitous Computing, (2014), 87-97.

Walter, R., Bailly, G., Valkanova, N. and Müller, J., Cuenesics: Using Mid-air Gestures to Select

Items on Interactive Public Displays. in MobileHCI '14: 16th international conference on Humancomputer

interaction with mobile devices & services, (2014), 299–308.

Downloads

Published

2017-06-30

Issue

Section

Articles