ENRICHING INFORMATION RETRIEVAL RESULTS WITH WEB ACCESSIBILITY MEASUREMENT
Keywords:
Web accessibility, Measurement, Information Retrieval, Quality Assurance, search enginesAbstract
Search engines are the most common gateway to search information in the WWW. Since Information Retrieval (IR) systems do not take Web accessibility issues into account, displayed results might not tailor to certain users’ needs such as people with disabilities or mobile devices’ users. In order to overcome this situation, we present a model aiming at considering Web accessibility as well as content relevance. The model consists of three components (Content Analysis Module, Accessibility Analysis Module and Results Collector Module) that carry out the following tasks: content analysis, automatic Web accessibility evaluation and accessibility measurement of results for re-ranking. Since criteria for ranking results provided by IR systems are necessary, quantitative metrics for accessibility have also been defined. Two prototypes that follow the specifications of the model have been developed in order to demonstrate the feasibility of this proposal. Finally, some case studies have been conducted aiming at discovering how traditional search engines deal with Web accessibility.
Downloads
References
Abascal, J., Arrue, M., Fajardo, I., Garay, N., and Tomás, J. Use of Guidelines to automatically
verify Web accessibility. International Journal of Universal Access in the Information Society
(1), 71-79, Springer, 2004.
Andronico, P., Buzzi, M., Castillo, C., and Leporini, B. Improving search engine interfaces for
blind users: a case study. International Journal of Universal Access in the Information Society
(1), 23-40, Springer, 2006.
Arrue, M., Vigo, M., and Abascal, J. Quantitative Metrics for Web Accessibility Evaluation. Proc.
of Workshop on Web Metrics and Measurement, co-located with 5th Intl. Conf. on Web
Engineering, ICWE 2005. University of Wollongong School of IT and Computer Science, 2005.
Arrue, M., Fajardo, I., López, J.M. and Vigo, M. Interdependence between technical Web
accessibility and usability: its influence on Web quality models. International Journal of Web
Engineering and Technology 3(3), 307-328, Inderscience, 2007.
Bailey, J. and Burd, E. Tree-Map Visualisation for Web Accessibility. 29th Computer Software
and Applications Conference, COMPSAC’05, 275-280, IEEE Computer Society Press, 2005.
Brajnik, G. Comparing accessibility evaluation tools: a method for tool effectiveness. International
Journal of Universal Access in the Information Society 3(3-4), 252-263, Springer, 2004.
Brajnik, G. Web Accessibility Testing with Barriers Walkthrough. 2006. Available at
www.dimi.uniud.it/giorgio/projects/bw
Brajnik, G. Ranking Web sites through Prioritized Web Accessibility Barriers. Technology and
Persons with Disabilities Conference, CSUN, California State University Northridge, 2007.
Brajnik, G. and Lomuscio, R. SAMBA: a Semi-Automatic Method for Measuring Barriers of
Accessibility. Proc. of 9th ACM SIGACCESS Conf. on Computers and Accessibility,
ASSETS’07, pages 43-49, ACM Press, 2007.
Bühler, C., Heck, H., Perlick, O., Nietzio, A., and Ullveit-Moe, N. Interpreting Results from Large
Scale Automatic Evaluation of Web Accessibility. Computers Helping People with Special Needs,
ICCHP 2006. Lecture Notes in Computer Science 4061, 184-191, Springer, 2006.
Caldwell, B., Cooper, M., Guarino Reid, L. and Vanderheiden, G. (eds). Web Content
Accessibility Guidelines 2.0. (W3C Candidate Recommendation). Available at
http://www.w3.org/TR/WCAG20/ (2008, April 30)
Chisholm, W., Vanderheiden, G., and Jacobs, I. (eds.). Web Content Accessibility Guidelines 1.0.
(W3C Recommendation). Available at http://www.w3.org/TR/WAI-WEBCONTENT/ 1999.
Fukuda, K., Saito, S., Takagi, H. and Asakawa, C. Proposing new metrics to evaluate Web
usability for the blind. Extended Abstracts Proc. of 2005 Conf. on Human Factors in Computing
Systems, CHI 2005, 1387-1390, ACM Press, 2005.
González, J., Macías, M., Rodríguez, R. and Sánchez, F. Accessibility Metrics of Web Pages for
Blind End-Users. In J.M. Cueva Lovelle et al. (eds.), Web Engineering. Lecture Notes in
Computer Science 2722, pages 374-383, Springer, 2003.
Good, A. and Jerrams-Smith, J. Enabling Accessibility and Enhancing Web Experience: Ordering
Search Results According to User Needs. Proc. of 4th Intl. Conf. on Universal Access in Human-
Computer Interaction UAHCI 2007. Universal Access in Human-Computer Interaction.
Applications and Services. Lecture Notes in Computer Science 4556, 34-44, Springer, 2007.
Gulliksen, J., Andersson, H. and Lundgren, P. Accomplishing universal access through system
reachability - a management perspective. International Journal Universal Access in the
Information Society 3(1), 96-101, Springer, 2004.
Hackett, S., Parmanto, B., and Zeng, X. (2004). Accessibility of Internet Web sites through time.
Proc. of 6th Intl. ACM SIGACCESS Conf. on Computers and Accessibility, 32-39. ACM Press,
Hoffman, D., Grivel, E. and Battle, L. Designing software architectures to facilitate accessible
Web applications. IBM Systems Journal 44(3), 467-483, 2005.
International Organization of Standardization (ISO). Ergonomics of human-system interaction:
Guidance on accessibility for human computer interfaces (ISO/TS 16071). Geneva, Switzerland,
International Organization of Standardization (ISO). Information Technology - Software Product
Evaluation (ISO 14598). Geneva, Switzerland, 1999.
International Organization of Standardization (ISO). Software Engineering - Product Quality -
Part1: Quality Model (ISO 9126-1). Geneva, Switzerland, 2001.
Ivory, M.Y. and Hearst M.A. The state of art in automating usability evaluations of user
interfaces. ACM Computing Surveys 33(4), 470-516, ACM Press, 2001.
Ivory, M.Y., Yu, S., and Gronemyer, K. Search result exploration: a preliminary study of blind
and sighted users’ decision making and performance. CHI 2004 Extended Abstracts, 1453-1456,
ACM Press, 2004.
Kobayashi, M. and Takeda, K. Information Retrieval on the Web. ACM Computing Surveys
(2), 144-173, ACM Press, 2000.
Leporini, B., Paternò, F. and Scorcia, A. Flexible tool support for accessibility evaluation.
Interacting with Computers 18(5), 869-890, Elsevier, 2006.
Masson, R. and Michel, G. A search engine for the visually impaired. Proc. of 8th Conf. for the
Advancement of Assistive Technology in Europe (AAATE), 573-577, 2005.
Mich, L., Franch, M. and Gaio, L. Evaluating and Designing Web Site Quality. IEEE Multimedia
(1), 34-43, 2003.
Olsina, L. and Rossi, G. Measuring Web Application Quality with WebQEM. IEEE Multimedia
(4), 20-29, 2002.
Parmanto, B. and Zeng, X. Metric for Web Accessibility Evaluation. Journal of the American
Society for Information Science and Technology 56(13), pages 1394-1404, Wiley, 2005.
Pemberton, S. The kiss of the spiderbot. interactions 10(1), 44, ACM Press, 2003.
Pemberton, S. Accessibility is for Everyone. interactions 10(6), 4-5, ACM Press, 2003.
Petrie, H. and Kheir, O. Relationship between Accessibility and Usability of Web sites. Proc. of
Conf. on Human Factors in Computing Systems, CHI 2007, 397-406, ACM Press, 2007.
Sullivan, T. and Matson, R. Barriers to use: usability and content accessibility on the Web’s most
popular sites. Proc. of ACM Conf. on Universal Usability 2000, CUU’2000, 139-144, ACM Press,
Takagi, H., Asakawa, C., Fukuda, K. and Maeda, J. Accessibility Designer: Visualizing Usability
for the Blind. Proc. of 6th ACM SIGACCESS Conference on Computers and Disability, ASSETS
, pages 177-184, ACM Press, 2005.
Thatcher, J., Burks, M.R., Heilmann, C., Lawton Henry, S., Kirkpatrick, A., Lauke, P.H., Lawson,
B., Regan, B., Rutter, R., Urban, M. and Waddell, C.D. Web Accessibility: Web Standards and
Regulatory Compliance. Springer-Verlag, New York, NY, 2006.
Vanderdonckt, J. and Bereikdar, A. Automated Web Evaluation by Guideline Review. Journal of
Web Engineering 4(2), 102-117, 2005.
Velleman, E., Meerbeld, C., Strobbe, C., Koch, J. Velasco, C.A., Snaprud, M. and Nietzio, A. DWAB4,
Unified Web Evaluation Methodology (UWEM 1.2 Core). 2007. Available at
http://www.wabcluster.org/uwem1_2/
Vigo, M., Arrue, M., Brajnik, G., Lomuscio, R. and Abascal, J. Quantitative Metrics for
Measuring Web Accessibility. Proc. of 2007 Intl. Cross-Disciplinary Conf. on Web accessibility,
W4A 2007, pages 99-107, ACM Press, 2007.
Yang, Y.F. and Hwang, S.L. Proc. of 4th Intl Conf on Universal Access in Human-Computer
Interaction UAHCI 2007. Universal Access in Human-Computer Interaction. Applications and
Services. Lecture Notes in Computer Science 4556, 997-1005, Springer, 2007.
Zhu, X. and Gauch, S. Incorporating quality metrics in centralized/distributed information
retrieval on the World Wide Web. Proc. of 23rd Annual Intl ACM SIGIR Conference on Research
and Development in Information Retrieval, 288-295, ACM Press, 2000.
