INTEGRATING INTERACTION DESIGN AND LOG ANALYSIS: BRIDGING THE GAP WITH UML, XML AND XMI
Keywords:
Methodology, interaction design, log analysis, UML, XML, DTD, XMI, search process, mediated information retrievalAbstract
In this paper, we describe and discuss a formal methodology that integrates the conceptual design of the user interaction for interactive systems with the analysis of the interaction logs. It is based on (i) formalizing, via UML state diagrams, the functionality that is supported by a system and the valid interactions that can take place; (ii) deriving XML schemas for capturing the interactions in activity logs; (iii) deriving log parsers that reveal the system states and the state transitions that took place during the interaction; and (iv) analyzing the state activities and the state transitions in order to describe the user interaction or to test some research hypotheses. While this approach is rather general and can be applied in studying a variety of interactive systems, it has been devised and applied in research work on exploratory information retrieval, where the focus is on studying the interaction and on finding interaction patterns. The details of the methodology are discussed and exemplified for a mediated retrieval experiment.
Downloads
References
Belkin, N.J., Cool, C., Stein, A., Thiel, U. (1995) Cases, scripts, and information-seeking
strategies: on the design of interactive information retrieval systems. Expert Systems with Applications,
(3), 379-395.
Belkin, N. J., Cool, C., Kelly, D., Lin, S.-j., Park, S., Perez-Carballo, J. and Sikora, C. (2001)
Iterative exploration, design and evaluation of support for query reformulation in interactive
information retrieval, Information Processing & Management, 37(3): 403-434.
Belkin, N.J., Cool, C., Kelly, D., Kim, G., Kim, J.-Y., Lee, H.-J., Muresan, G., Tang, M.-C.,
Yuan X.-J. (2002) Rutgers Interactive Track at TREC 2002, in Proceedings of TREC 2002,
Gaithersburg, November 2002.
Carlson, D. (2001) Modeling XML applications with UML: Practical e-Business applications,
Addison-Wesley, ISBN: 0-201-70915-5.
Carlson D. (2006) Semantic models for XML schema with UML tooling. Proceedings of the
nd International Workshop on Semantic Web Enabled Software Engineering (SWESE), Nov 2006,
Athens, GA..
Crowle, S. and Hole, L. (2003) ISML: An interface specification meta-language, 10th
International Workshop on Design, Specification and Verification of Interactive Systems, Madeira.
Diaper, D. and Stanton, N. (2004) The handbook of task analysis of Human-Computer
Interaction, Lawrence Erlbaum Associates, ISBN 0-8058-4433-3.
Douglass, B. P. (1999) Doing hard time: Developing real-time systems with UML, objects,
frameworks, and patterns, Addison-Wesley, Reading, MA.
Dumais, S. T. and Belkin, N. J. (2005) The TREC Interactive tracks: Putting the user into
search, in TREC – Experiment and evaluation in Information Retrieval, eds. Voorhees, E. M. and
Harman, D. K., MIT Press, Cambridge, MA, ISBN 0-262-22073-3.
Ellis, D. (1989) A behavioral approach to information retrieval system design. The Journal of
Documentation, 45(3), 171-212.
Fisher, K. E., Erdelez S. and McKechnie, L. (2005) Theories of Information Behavior,
Information Today, Medford, NJ.
Fowler, Martin (2004) UML distilled: A brief guide to the standard object modeling
language, 3rd ed, Addison-Wesley/Pearson Education.
Gamma, E., Helm, R., Johnson, R. and Vlissides, J. (1995) Design Patterns – Elements of
Reusable Object-Oriented Software, Addison-Wesley, Reading, MA.
Gonçalves, M. A., Panchanathan, G., Ravindranathan, U., Krowne, A., Fox, E. A.,
Jagodzinski, F. and Cassel, L. (2003) The XML Log Standard for Digital Libraries: Analysis,
Evolution, and Deployment. The Third Joint Conference in Digital Libraries (JCDL), Houston, Texas,
May 2003.
Harel, D. (1988) On visual formalisms, Communications of the ACM, 31 (5).
Hersh, W. (2002) TREC 2002 Interactive Track Report, Proceedings of TREC 2002,
Gaithersburg, Nov 2002.
Horrocks, I. (1999) Constructing the User Interface with Statecharts, Addison-Wesley, ISBN
-210-34278-2.
Ingwersen, P. and Jarvelin, K. (2005) The Turn – Integration of Information Seeking and
Retrieval in Context. Springer.
Jurafsky, D. and Martin, James H. (2000) Speech and language processing, Prentice-Hall,
ISBN 0-13-095069-6.
Klas, C.-P., Albrechtsen, H., Fuhr, N., Hansen, P., Kapidakis, S., Kovacs, L., Krievel, S.,
Micsik, A., Papatheodorou, C., Tsakonas, G. and Jacob, E. (2006) A Logging Scheme for Comparative
Digital Library Evaluation, in Proceedings of the 10th European conference on research and advanced
technology for digital libraries (ECDL 2006), Alicante.
Kuhlthau, C. (1991) Inside the search process: information seeking from the user’s
perspective. Journal of the American Society for Information Science, 42(5), 361-371.
Lee, H.-J. (2006) Mediated Information Retrieval for the Web Environment, Ph.D.
dissertation, School of Communication, Information and Library Studies, Rutgers University, New
Brunswick, NJ, May 2006.
Limbourg, Q. and Vanderdonckt, J. (2004) Comparing task models for user interface design,
in Diaper, D. and Stanton, N. (eds.) The handbook of task analysis of Human-Computer Interaction,
Lawrence Erlbaum Associates, ISBN 0-8058-4433-3.
Muresan, G. (2002) Using Document Clustering and Language Modelling in Mediated
Information Retrieval, Ph.D. dissertation, School of Computing, The Robert Gordon University,
Aberdeen, Scotland, January 2002.
Muresan, G. and Harper, D. J. (2001) Document Clustering and Language Models for
System-Mediated Information Access in Proceedings of the 5th European Conference on Research and
Advanced Technology for Digital Libraries, Darmstadt, 4-9 September 2001, 438-449, ISBN 3-540-
-3.
Muresan, G. and Harper, D. J. (2004) Topic Modelling for Mediated Access to Very Large
Document Collections, JASIST 55 (10): 892-910, Special Topics Issue: Document Search Interface
Design for Large-Scale Collections and Intelligent Access, August 2004.
Olah, J. (2005) Shifts Between Search Stages During Task-Performance in Mediated
Information-Seeking Interaction, Proceedings of the 68th Annual Meeting of the American Society for
Information Science (ASIST), 42, Charlotte, NC.
Paterno, F. (2001) Towards a UML for Interactive Systems, Proceedings of the 8th IFIP
International Conference on Engineering for Human-Computer Interaction, Toronto, May 2001, 7-8,
ISBN:3-540-43044-X.
Paterno, F. (2004) ConcurTaskTrees: an engineered notation for task models, in Diaper, D.
and Stanton, N. (eds.) The handbook of task analysis of Human-Computer Interaction, Lawrence
Erlbaum Associates, ISBN 0-8058-4433-3.
Robertson, S.E., Hancock-Beaulieu, M.M. (1992) On the evaluation of IR systems.
Information Processing and Management, 28(4), 457-466.
Saracevic, T. (1996) Interactive models in information retrieval (IR). A review and proposal.
Proceedings of the 59th Annual Meeting of the American Society for Information Science (ASIST), 33,
-9.
Sharp, H., Rogers, Y. and Preece, J. (2007) Interaction design, Wiley, ISBN: 978-0-470-
-8.
Shneiderman, B. and Plaisant, C. (2005) Section 5.2: Specification Methods, in Designing the
User Interface, Addison-Wesley / Pearson Education, p.175-183.
Tidwell, J. (2006) Designing interfaces, O’Reilly, ISBN 0-596-00803-1.
Trætteberg, H. (2003) Dialog modelling with interactors and UML Statecharts - A hybrid
approach, 10th International Workshop on Design, Specification and Verification of Interactive
Systems, Madeira.
Vakkari, P. (1999) Task complexity, problem structure and information actions, integrated
studies on information seeking and retrieval. Information Processing and Management, 35, 819-837.
Vakkari, P. (2001) Changes in search tactics and relevance judgments when preparing a
research proposal: a summary and generalization of a longitudinal study. Journal of Documentation,
(1), 44-60.
Voorhees, E. M. and Harman (2005) TREC – Experiment and Evaluation in Information
Retrieval, MIT Press, Cambridge, MA, ISBN 0-262-22073-3.
Winckler, M. and Palanque, P. (2003) StateWebCharts: a Formal Description Technique
Dedicated to Navigation Modelling of Web Applications, 10th International Workshop on Design,
Specification and Verification of Interactive Systems, Madeira.
Xie, H. (2000) Shifts of interactive intentions and information-seeking strategies in
interactive information retrieval. Journal of the American Society for Information Science, 51(9), 841-
