DIREWOLF: A FRAMEWORK FOR WIDGET-BASED DISTRIBUTED USER INTERFACES
Keywords:
distributed user interface, Web widget, inter-widget communication, XMPP, WebRTCAbstract
Web applications have overcome traditional desktop applications especially in collab- orative settings. However, the bulk of Web applications still follow the \single user on a single device" computing model. Therefore, we created the DireWolf framework for rich Web applications with distributed user interfaces (DUIs) over a federation of heterogeneous commodity devices supporting modern Web browsers such as laptops, smart phones and tablet computers. The DUIs are based on widget technology coupled with cross-platform inter-widget communication (IWC) and seamless session mobility. Inter-widget communication technologies connect the widgets and enable real-time col- laborative applications as well as runtime migration in our framework. We show that the DireWolf framework facilitates the use case of DUI-enabled semantic video annotation. For a single user it provides more exible control over dierent parts of an application by enabling the simultaneous use of smart phones, tablets and computers. We con- ducted a technical evaluation and two user studies to validate the DireWolf approach. The work presented opens the way for creating distributed Web applications which can access device specic functionalities such as multi-touch, text input, etc. in a federated and usable manner. In this paper, we also sketch our ongoing work to integrate the WebRTC API into DireWolf, where we see opportunities for potential adoption of DUI Web applications by the majority of Web users.
Downloads
References
J. J. Lopez-Espin, J. A. Gallud, E. Lazcorreta, A. Pe~nalver, and F. Botella. A Formal View of
Distributed User Interfaces. In Proceedings of the Distributed User Interfaces CHI 2011 Workshop,
pages 97{100, Vancouver, BC, Canada, 2011. University of Castilla-La Mancha, Spain.
C. Vandervelpen, G. Vanderhulst, K. Kris Luyten, and K. Coninx. Light-Weight Distributed
Web Interfaces: Preparing the Web for Heterogeneous Environments. In Proceedings of the 5th
International Conference on Web Engineering, volume 3579 of LNCS, pages 197{202, Sydney,
Australia, 2005. Springer-Verlag Berlin.
M. Blumendorf, D. Roscher, and S. Albayrak. Distributed User Interfaces for Smart Environments:
Characteristics and Challenges. In Proceedings of the Distributed User Interfaces CHI
Workshop, pages 25{28, Vancouver, BC, Canada, 2011. University of Castilla-La Mancha,
Spain.
J. Vanderdonckt. Distributed User Interfaces: How to Distribute User Interface Elements Across
Users, Platforms, and Environments. In Proceedings of the XI Congreso Internacional Interaccion
Persona-Ordenador, INTERACCION 2010, pages 20{32, Valencia, Spain, 2010. ACM.
E. Bogdanov, C. Salzmann, and D. Gillet. Contextual Spaces with Functional Skins as OpenSocial
Extension. In Proceedings of the Fourth International Conference on Advances in Computer-
Human Interactions (ACHI 2011), pages 158{163, Gosier, Guadeloupe, France, 2011.
F. Daniel, S. Soi, S. Tranquillini, F. Casati, C. Heng, and L. Yan. Distributed Orchestration of
User Interfaces. Information Systems, 37(6):539{556, 2012.
G. Ghiani, F. Paterno, and C. Santoro. On-demand Cross-Device Interface Components Migration.
In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile
Devices and Services (MobileHCI '10), pages 299{308, Lisabon, Portugal, 2010. ACM Press.
L. Baillie, R. Schatz, R. Simon, H. Anegg, F. Wegscheider, G. Niklfeld, and A. Gassner. Designing
Mona: User Interactions with Multimodal Mobile Applications. In Proceedings of 11th Interna-
tional Conference on Human-Computer Interaction (HCI International), pages 22{27, Las Vegas,
NV, USA, 2005. Lawrence Erlbaum Associates.
K. Luyten and K. Coninx. Distributed User Interface Elements to support Smart Interaction
Spaces. In Proceedings of the Seventh IEEE International Symposium on Multimedia, ISM '05,
pages 277{286, Irvine, CA, USA, 2005. IEEE Computer Society.
P. G. Villanueva, R. Tesoriero, and J. A. Gallud. Proxywork: Distributing User Interface Components
of Web Applications. In Proceedings of the 3rd Workshop on Distributed User Interfaces:
Models, Methods and Tools, DUI 2013 in conjunction with EICS 2013 Conference, pages 58{61,
London, UK, 2013.
J. Melchior, D. Grolaux, J. Vanderdonckt, and P. van Roy. A Toolkit for Peer-to-peer Distributed
User Interfaces: Concepts, Implementation, and Applications. In Proceedings of the 1st ACM
SIGCHI Symposium on Engineering Interactive Computing Systems, pages 69{78, Pittsburgh,
PA, USA, 2009. ACM Press.
C. Jennings, T. Hardie, and M. Westerlund. Real-time communications for the Web. IEEE
Communications Magazine, 51(4):20{26, 2013.
A. Bergkvist, D. C. Burnett, C. Jennings, and A. Narayanan. WebRTC 1.0: Real-time Communication
Between Browsers. Working draft, W3C, 2013.
H.-H. Chu, H. Song, C. Wong, S. Kurakake, and M. Katagiri. Roam, a Seamless Application
Framework. Journal of Systems and Software, 69(3):209{226, 2004.
A. Alapetite. Dynamic 2D-barcodes for Multi-Device Web Session Migration Including Mobile
Phones. Personal Ubiquitous Computing, 14(1):45{52, 2010.
F. Paterno, C. Santoro, and A. Scorcia. User Interface Migration Between Mobile Devices and
Digital TV. In Proceedings of the 2nd Conference on Human-Centered Software Engineering
and 7th International Workshop on Task Models and Diagrams, pages 287{292, Pisa, Italy, 2008.
Springer-Verlag Berlin.
B. A. Myers. Using Handhelds and PCs Together. Communications of the ACM, 44(11):34{41,
F. Daniel, S. Soi, S. Tranquillini, F. Casati, H. Chang, and Y. Li. MarcoFlow: Modeling, Deploying,
and Running Distributed User Interface Orchestrations. In Proceedings of the 8th International
Conference on Business Process Management Demo Track, BPM 2010, pages 23{27, Hoboken,
NJ, USA, 2010. Springer.
J. S. Pierce and J. Nichols. An Infrastructure for Extending Applications' User Experiences Across
Multiple Personal Devices. In Proceedings of the 21st Annual ACM Symposium on User Interface
Software and Technology (UIST '08), pages 101{110, Monterey, CA, USA, 2008. ACM Press.
S. Wilson, F. Daniel, U. Jugel, and S. Soi. Orchestrated User Interface Mashups Using W3C Widgets.
In Proceedings of the 11th International Conference on Current Trends in Web Engineering,
ICWE'11, pages 49{61, Paphos, Cyprus, 2011. Springer-Verlag.
S. Govaerts, K. Verbert, D. Dahrendorf, C. Ullrich, M. Schmidt, M.Werkle, A. Chatterjee, A. Nussbaumer,
D. Renzel, M. Sche el, M. Friedrich, J. L. Santos, E. Duval, and E. L.-C. Law. Towards
Responsive Open Learning Environments: the ROLE Interoperability Framework. In Proceedings
of the 6th European Conference on Technology Enhanced Learning: Towards Ubiquitous Learning,
EC-TEL'11, pages 125{138, Palermo, Italy, 2011. Springer-Verlag.
OpenSocial and Gadgets Speci cation Group. OpenSocial Speci cation 2.5.0. http://opensocialresources.
googlecode.com/svn/spec/2.5/. Online: last accessed March 2013.
P. Saint-Andre. RFC 6121: Extensible Messaging and Presence Protocol (XMPP): Instant Messaging
and Presence. Technical report, XMPP Standards Foundation, 2011.
I. Hickson. HTML5 Web Messaging. Working draft, W3C, 2011.
P. Millard, P. Saint-Andre, and R. Meijer. XEP-0060: Publish-Subscribe Version 1.13, Draft.
Technical report, XMPP Standards Foundation, 2010.
I. Hickson. The WebSocket API. Editor's draft, W3C, 2013.
Y. Cao, D. Renzel, M. Jarke, R. Klamma, M. Lottko, G. Toubekis, and M. Jansen. Well-Balanced
Usability and Annotation Complexity in Interactive Video Semantization. In Proceedings of the
th International Conference on Multimedia and Ubiquitous Engineering (MUE 2010), pages 1{8,
Cebu, Philippines, 2010. IEEE.
