INSTRUMENTING THE DYNAMIC WEB
Keywords:
Usability, analytics, event log analysis, AJAX, interaction designAbstract
One of the most critical driving forces in the evolution of interfaces on the Internet has been the logging built into common Web servers and the decade-long deployment of analytics based upon this data source. Page-view logging has slowly moved to callback systems using client-side scripting to capture more aspects of the user experience. With the rise of JavaScript-based client-side interactivity and, more recently, asynchronous Javascript and XML (AJAX), server-side logging is less able to capture the user experience of Web sites and applications that are rising in complexity. We present a new technique for the in-page logging of interaction events that will help interaction designers make more informed design decisions based on how users are interacting with their systems. The potential benefit of our technique is demonstrated in a case study with a working system.
Downloads
References
Kohavi, R. (2001). Mining e-commerce data: the good, the bad, and the ugly. In Proceedings of the 7th
ACM SIGKDD international Conference on Knowledge Discovery and Data Mining, 8-13.
Catledge, L.D., and Pitkow, J.E. (1995). Characterizing browsing strategies in the World Wide Web.
Computer Networks and ISDN Systems, 27(6): 1065-1073.
Huberman, B., Pirolli, P., Pitkow, J., and Lukose, R. (1998). Strong regularities in World Wide Web surfing.
Science, 280(5360): 95–97.
Peterson, E. (2006). Web Analytics Demystified: A Marketer's Guide to Understanding How Your Web
Site Affects Your Business. Celilo Group Media: Portland.
Chi, E.H., Pirolli, P., and Pitkow, J. (2000). The scent of a site: a system for analyzing and predicting
information scent, usage, and usability of a Web site. In Proceedings of the SIGCHI conference on Human
Factors in Computing Systems, 161-168.
Weinreich, H., Obendorf, H., Herder, E., and Mayer, M. (2006). Off the beaten tracks: Exploring three
aspects of Web navigation. In Proceedings of the World Wide Web Conference, 133-142.
Cutrell, E. and Guan, Z. (2007). What are you looking for? An eye-tracking study of information usage in
Web search. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (in
press).
Reeder, R.W., Pirolli, P., and Card, S.K. (2001). WebEyeMapper and WebLogger: Tools for
analyzing eye tracking data collected in Web-use studies. In Extended Abstracts of the ACM
SIGCHI Conference on Human Factors in Computing Systems, 19-20.
Gellner, M. and Forbrig, F. (2003). ObSys: A tool for visualizing usability evaluation patterns
with mousemaps. In Proceedings of HCI International, 469-473.
Atterer, R., Wnuk, M., and Schmidt, A. (2006). Knowing the user's every move: User activity
tracking for Website usability evaluation and implicit interaction. In Proceedings of the World
Wide Web Conference, 203-212.
Nielsen, J. (1990). Hypertext and Hypermedia. Academic Press.
Hilbert, D. and Redmiles, D. (2001). Large-scale collection of usage data to inform design. In Proceedings
of 8th IFIP TC 13 Conference on Human-Computer Interaction, 569-576.
Pitkow, J. and Pirolli, P. (1999). Mining longest repeating subsequences to predict World Wide Web surfing.
In Proceedings of the USENIX Symposium, 139-150.
Chen, M.C., Anderson, J.R., Sohn, M.H. (2001). What can a mouse cursor tell us more? Correlation of
eye/mouse movements on Web browsing. In Extended Abstracts of the ACM SIGCHI Conference on Human
Factors in Computing Systems, 281-282.
Claypool, M., Le, P., Waseda, M., and Brown, D. (2001). Implicit interest indicators. In Proceedings of the
Conference on Intelligent User Interfaces, 33-40.
Fox, S., Karnawat, K., Mydland, M., Dumais, S.T., and White, T. (2005). Evaluating implicit
measures to improve the search experience. ACM Transactions on Information Systems, 23(2):
-168.
Joachims, T., Granka, L., Pan, B., Hembrooke, H., and Gay, G. (2005). Accurately interpreting clickthrough
data as implicit feedback. In Proceedings of the 28th Annual ACM SIGIR Conference on Research and
Development in Information Retrieval, 154-161.
Lockerd, A. and Mueller, F. (2001). Cheese: Tracking mouse movements on websites. In Proceedings of the
ACM SIGCHI Conference on Human Factors in Computing Systems, 279-280.
Edmonds, A. (2003). Uzilla: A new tool for Web usability testing. Behavior Research Methods,
Instrumentation and Computers, 32(2): 194-201.
Agichtein, E., Brill, E., Dumais, S.T., and Ragno, R. (2006). Learning user interaction models
for predicting Web search preferences. In Proceedings of the 29th Annual ACM SIGIR
Conference on Research and Development in Information Retrieval, 3-10.
Hong, J. and Landay, J. (2001). WebQuilt: A proxy-based approach to remote Web usability
testing. ACM Transactions on Information Systems, 19(3): 263-285.
Miyata, Y. and Norman, D.A. (1986). Psychological issues in support of multiple activities. In Norman, D.
A. and Draper, S.W. (Eds.) User Centered Design, Lawrence Erlbaum, 265-284.
Rubenstein, J.S., Meyer, D.E, and Evans, J.E. (2001). Executive control of cognitive processes in task
switching. Journal of Experimental Psychology, 27(4): 763-797.
Czerwinski, M., Horvitz, E., and Wilhite, S. (2004). A diary study of task switching and interruptions. In
Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, 175-182.
Horvitz, E., Kadie, C.M., Paek, T., and Hovel, D. (2003). Models of attention in computing and
communication: From principles to applications. Communications of the ACM, 46(3): 52-59.
