PATTERNS IN EYETRACKING SCANPATHS AND THE AFFECTING FACTORS
Keywords:
eyetracking, scanpaths, patterns, commonality, reengineeringAbstract
Web pages are typically decorated with dierent kinds of visual elements that help sighted people complete their tasks. Unfortunately, people accessing web pages in constrained environments, such as visually disabled and small screen device users, cannot benet from them. In our previous work, we show that tracking the eye movements of sighted users provide good understanding of how people use these visual elements. We also show that reengineering web pages by using these visual elements can improve people's experience in constrainted environments. However, in order to reengineer web pages based on eyetracking, we rst need to aggregate, analyse and understand how a group of people's eyetracking data can be combined to create a common scanpath (namely, eye movement sequence) in terms of visual elements. This paper presents an algorithm that aims to achieve this. This algorithm was developed iteratively and experimentally evaluated with an eyetracking study. This study shows that the proposed algorithm is able to identify patterns in eyetracking scanpaths and it can work well with dierent number of participants. We then extended our experiments to investigate the eects of the task, gender and familiarity factors on common scanpaths. The results suggest that these factors can cause some dierences in common scanpaths. This study also suggests that this algorithm can be improved by considering dierent techniques for pre- processing the data, by addressing the drawbacks of using the hierarchical structure and by taking into account the underlying cognitive processes.
Downloads
References
Elgin Akpinar and Yeliz Yesilada. Heuristic Role Detection of Visual Elements of Web Pages. In
Florian Daniel, Peter Dolog, and Qing Li, editors, Web Engineering, volume 7977 of Lecture Notes
in Computer Science, pages 123{131. Springer Berlin Heidelberg, 2013.
Elgin Akpinar and Yeliz Yesilada. Vision Based Page Segmentation Algorithm: Extended and
Perceived Success. In Sheng Q. Z. and Kjeldskov J. (eds.) Current Trends in Web Engineering -
ICWE 2013 Workshops and PhD Symposium., volume 8295 of Lecture Notes in Computer Science,
pages 238{252. Springer, 2013.
Stephan A. Brandt and Lawrence W. Stark. Spontaneous Eye Movements During Visual Imagery
Re
ect the Content of the Visual Scene. J. Cognitive Neuroscience, 9(1):27{38, January 1997.
Andy Brown, Caroline Jay, and Simon Harper. Audio access to calendars. In W4A '10, pages
{10, New York, NY, USA, 2010. ACM.
Andy Brown, Caroline Jay, and Simon Harper. Using qualitative eye-tracking data to inform
audio presentation of dynamic web content. New Rev. Hypermedia Multimedia, 16(3):281{301,
December 2010.
Chung Han Chiang. A Genetic Algorithm for the Longest Common Subsequence of Multiple
Sequences. Master's thesis, National Sun Yat-sen University, 2009.
Filipe Cristino, Sebastiaan Mathot, Jan Theeuwes, and Iain D. Gilchrist. Scanmatch: a novel
method for comparing xation sequences. Behavior Research Methods, 42(3):692{700, 2010.
Sukru Eraslan, Yeliz Yesilada, and Simon Harper. Identifying patterns in eyetracking scanpaths
in terms of visual elements of web pages. In Sven Casteleyn, Gustavo Rossi, and Marco Winckler,
editors, Web Engineering, volume 8541 of Lecture Notes in Computer Science, pages 163{180.
Springer International Publishing, 2014.
Tom Foulsham and Geo rey Underwood. What can Saliency Models Predict about Eye Movements?
Spatial and Sequential Aspects of Fixations during Encoding and Recognition. Journal of
Vision, 8(2):1{17, 2008.
Joseph H. Goldberg and Jonathan I. Helfman. Scanpath clustering and aggregation. In ETRA
'10, pages 227{234, NY, USA, 2010. ACM.
Helene Hembrooke, Matt Feusner, and Geri Gay. Averaging scan patterns and what they can tell
us. In ETRA '06, pages 41{41, New York, NY, USA, 2006. ACM.
Halszka Jarodzka, Kenneth Holmqvist, and Marcus Nystrom. A Vector-based, Multidimensional
Scanpath Similarity Measure. In ETRA '10, ETRA '10, pages 211{218, New York, NY, USA,
ACM.
Caroline Jay and Andy Brown. User Review Document: Results of Initial Sighted and Visually
Disabled User Investigations. Technical report, University of Manchester, 2008.
Sheree Josephson and Michael E. Holmes. Visual attention to repeated internet images: testing
the scanpath theory on the world wide web. In ETRA '02, pages 43{49, NY, USA, 2002. ACM.
Gary Marchionini. Exploratory Search: From Finding to Understanding. Commun. ACM,
(4):41{46, April 2006.
Marcus Mast and Michael Burmester. Exposing repetitive scanning in eye movement sequences
with t-pattern detection. In IADIS IHCI '11, pages 137{145, Rome, Italy, 2011.
Eleni Michailidou. ViCRAM: Visual Complexity Rankings and Accessibility Metrics. PhD thesis,
University of Manchester, 2010.
Alex Poole and Linden J. Ball. Eye tracking in human-computer interaction and usability research:
Current status and future. In Prospects, Chapter in C. Ghaoui (Ed.): Encyclopedia of Human-
Computer Interaction. Pennsylvania: Idea Group, Inc, 2005.
Kari-Jouko Raiha. Some applications of string algorithms in human-computer interaction. In Tapio
Elomaa, Heikki Mannila, and Pekka Orponen, editors, Algorithms and Applications, volume 6060
of Lecture Notes in Computer Science, pages 196{209. Springer Berlin Heidelberg, 2010.
Anthony Santella and Doug DeCarlo. Robust clustering of eye movement recordings for quanti
cation of visual interest. In ETRA '04, ETRA '04, pages 27{34, New York, NY, USA, 2004.
ACM.
Haruhiko Takeuchi and Yoshiko Habuchi. A quantitative method for analyzing scan path data
obtained by eye tracker. In CIDM '07, pages 283 {286, 1 2007-april 5 2007.
W3C WAI Research and Development Working Group (RDWG). Research Report on Mobile Web
Accessibility. In Simon Harper, Peter Thiessen, and Yeliz Yesilada, editors, W3C WAI Symposium
on Mobile Web Accessibility, W3C WAI Research and Development Working Group (RDWG)
Notes. W3C Web Accessibility Initiative (WAI), rst public working draft edition, December
Julia M. West, Anne R. Haake, Evelyn P. Rozanski, and Keith S. Karn. eyePatterns: software for
identifying patterns and similarities across xation sequences. In ETRA '06, pages 149{154, NY,
USA, 2006. ACM.
Yeliz Yesilada, Simon Harper, and Sukru Eraslan. Experiential transcoding: An EyeTracking
approach. In W4A '13, page 30. ACM, 2013.
Yeliz Yesilada, Caroline Jay, Robert Stevens, and Simon Harper. Validating the Use and Role of
Visual Elements ofWeb Pages in Navigation with an Eye-tracking Study. In The 17th international
conference on World Wide Web, WWW '08, pages 11{20, New York, NY, USA, 2008. ACM.
Yeliz Yesilada, Robert Stevens, Simon Harper, and Carole Goble. Evaluating DANTE: Semantic
Transcoding for Visually Disabled Users. ACM Trans. Comput.-Hum. Interact., 14(3):14, September
