AUTOMATED WEB EVALUATION BY GUIDELINE REVIEW
Keywords:
usability, accessibility, automated evaluation of web sites, static analysis, guideline definition language, evaluation engineAbstract
A novel approach is presented for automatically evaluating of the usability and accessibility (U&A) of web sites by performing a static analysis of their HTML code against U&A guidelines. The approach relies on separating guidelines evaluation logic from the evaluation engine. Due to this separation, the whole evaluation process can be divided into two main phases: specifying formal guidelines and web page evaluation. In the first phase, the formal structure of a guideline is expressed in terms of Guideline Definition Language (GDL). In the second phase, the web page is parsed to identify its contents and structure and link them to relevant guidelines to be evaluated on the page parsed. This approach enables the simultaneous evaluation of multiple guidelines selected on demand from different sources. It also optimises evaluation by automatically identifying common sub-structures among structured guidelines. It also supports the expression, by evaluators with different usability practises, of alternative evaluation strategies.
Downloads
References
Abascal, J., Arrue, M., Fajardo I., Garay, N., Tomas, J. Use of Guidelines to automatically verify
web accessibility. Universal Access in the Information Society, 3(1), 2004, 71–79.
ATRC, A-Prompt: Web Accessibility Verifier. Adaptive Technology Resource Center (University
of Toronto) and Trace Center (University of Wisconsin), Canada & USA. On-line at
Beirekdar, A., Vanderdonckt, J. and Noirhomme-Fraiture, M.: A Framework and a Language for
Usability Automatic Evaluation of Web Sites by Static Analysis of HTML Source Code. in Proc.
of 4th Int. Conf. on Computer-Aided Design of User Interfaces CADUI’2002 (Valenciennes, 15-17
May 2002). Kluwer Academics Pub., 2002, 337–348.
Brajnik, G.: Automatic Web Usability Evaluation: Where is the Limit? in Proc. of the 6th Conf. on
Human Factors & the Web (Austin, 19 June 2000). University of Texas, Austin, 2000. On-line at
http://www.tri.sbc.com/hfweb/ brajnik/hfweb-brajnik.html
Cooper, M., Evaluating Accessibility and Usability of Web Sites. in Proc. of 3rd Int. Conf. on
Computer-Aided Design of User Interfaces CADUI’99 (Louvain-la-Neuve, 21-23 October 1999).
Kluwer Academics Publisher, 1999, 33–42.
Forrester Research: Why most web sites fail. 1999. On-line at http://www.
forrester.com/Research/ReportExcerpt/0,1082,1285,00.html
Ivory, M.Y. and Hearst, M.A., State of The Art in Automating Usability Evaluation of User
Interfaces. ACM Computing Surveys, 2001.
Ivory, M.Y., Mankoff, J. and Le, A., Using Automated Tools to Improve Web Site Usage by
Users With Diverse Abilities. IT&Society, 1(3). 195–236. On-line at http://www.stanford.edu/
group/siqss/itandsociety/v01i03/v01i03a11.pdf
Jackson-Sanborn, E., Odess-Harnish, K. and Warren, N., Website Accessibility: A Study of ADA
Compliance. Technical Report TR-2001-05. School of Information and Library Science,
University of North Carolina at Chapel Hill, 2001. On-line at
http://ils.unc.edu/ils/research/reports/accessibility.pdf
Murch, G.M., Colour Graphics - Blessing or Ballyhoo? The Visual Channel. in Baecker, R.M. and
Buxton, W.A.S. eds. Readings in Human-Computer Interaction - A Multidisciplinary Approach.
Morgan Kaufmann Publishers, 1987, 333–341.
Scapin, D., Leulier, C., Vanderdonckt, J., Mariage, C., Bastien, C., Farenc, C., Palanque, P. and
Bastide, R., A Framework for Organizing Web Usability Guidelines. in Kortum, Ph. and
Kudzinger, E. eds. Proc. of the 6th Conf. on Human Factors & the Web (Austin, 19 June 2000).
University of Texas, Austin, 2000. On-line at http://www.tri.sbc.com/hfWeb/scapin/Scapin.html
Vanderheiden, G.C., Chisholm, W.A., Ewers, N. and Dunphy, S.M., Unified Web Site
Accessibility Guidelines, Version 7.2, Trace Center, University of Wisconsin-Madison, 1997. Online
at http://trace.wisc.edu/text/guidelns/ htmlgide/htmlgide.htm
