QUALITY AND POTENTIAL FOR ADOPTION OF USABILITY EVALUATION METHODS: AN EMPIRICAL STUDY ON MILE+
Keywords:
web usability, quality, empirical study, inspection, heuristicsAbstract
Web usability evaluation methods are conceptual tools which should enable web designers, web engineers and usability engineers to detect and possibly anticipate usability problems of a web application, and eventually to provide requirements for improving the quality of the user experience. As the number of techniques and methods available grows, practitioners need clear criteria to choose which methods best fit their project needs, resources and organizational goals. Therefore, it becomes more and more important to foster research towards evaluating the quality of the usability evaluation methods, especially in view of their potential adoption among practitioners. Besides focussing on known attributes of intrinsic quality of the method (such as coverage, reliability and validity), this paper also explores “perceived” quality attributes related to the potential adoption of the method among practitioners, namely in terms of learnability, perceived difficulty, and cost-effectiveness. We report two empirical studies which have been carried out to measure these quality attributes on a state-of-the-art inspection method for web usability, called MiLE+. The result of this work can be useful to scholars because it provides validation examples and a set of quality attributes to apply to other usability evaluation methods; it also benefits practitioners because it offers a clear guidance about what requirements they should look for when selecting a usability evaluation method for their own project needs.
Downloads
References
Bolchini D., Triacca L., Speroni M. MiLE: a Reuse-oriented Usability Evaluation Method for
the Web, Proc. HCI International Conference 2003, Crete, Greece.
Brinck, T., Gergle, D., Wood, S.D., Usability for the web, Morgan Kaufmann, 2002.
Carroll, J., Making Use – Scenario-based design of Human-Computer Interactions, MIT Press,
Cato, J., User-Centred web Design, Addison Wesley, 2001.
De Angeli A., M.F. Costabile, M. Matera, F. Garzotto, P. Paolini. On the advantages of a
Systematic Inspection for Evaluating Hypermedia Usability. In International Journal of Human
Computer Interaction, Erlbaoum Publ. Vol. 15 (3), June 2003, pp. 315-336.
Dix, A., Finlay, J., Abowd, G., and Beale, R., Human Computer Interaction, 2nd ed.
Englewood Cliffs, NJ: Prentice-Hall, 1998.
Lim, K.H., Benbasat, I. and Todd, P.A., An experimental investigation of the interactive
effects of interface style, instructions, and task familiarity on user performance, ACM Trans.
Comput. Hum. Interact., vol. 3, no 1,pp. 1-37, January 1996.
Matera, M., Costable M.F., Garzotto F., Paolini P., SUE Inspection: An Effective Method for
Systematic Usability Evaluation of Hypermedia, IEEE Transactions on Systems, Men, and
Cybernetics, Vol.32, No. 1, January 2002.
Nielsen, J., Designing Web Usability, New Riders, 1999.
Nielsen, J., Mack, R., Usability Inspection Methods, Wiley 1994.
Rosson, M.B., Carroll, J., Usability Engineering, Morgan Kaufmann, 2002.
Triacca L, Bolchini D., Botturi L., Inversini A, (2004). MiLE: Systematic Usability Evaluation
for E-learning Web Applications. ED Media 04, Lugano, Switzerland.
Whiteside J., Bennet J., and Holtzblatt K., Usability engineering: Our experience and
evolution, in Handbook of Human-Computer Interaction, M.Helander, Ed. Amsterdam, The
Netherlands, North-Holland, 1988, pp.791-817.
Triacca, L., Web Usability – Enhancing the effectiveness of the methodologies and improving
their communication features, PhD Thesis, Università della Svizzera italiana, 2005.
Bolchini, D., Paolini, P., Interactive Dialogue Model: a Design Technique for Multi-Channel
Applications, IEEE Transactions on Multimedia, 8 (3) 2006, 529-541.
Bolchini, D., Garzotto, F., Designing Multichannel Web Applications as “Dialogue Systems”:
the IDM model, in Rossi, G.; Pastor, O.; Schwabe, D.; Olsina, L. (Eds.), Web Engineering:
Modelling and Implementing Web Applications, Series: Human-Computer Interaction Series,
Vol. 12, ISBN: 978-1-84628-922-4, Springer, October 2007.
Hartson, H.R., Andre, T.S., Williges, R.C., Criteria for Evaluating Usability Evaluation
Methods, in International Journal of Human Computer Interaction, 15 (1), 2003, 145-181.
Gray,W. D., & Salzman, M. C., Damaged merchandise? Areview of experiments that compare
usability evaluation methods. Human–Computer Interaction, 13, 1998, 203–262.
Rogers, Everett M. (2003). Diffusion of Innovations, Fifth Edition. New York, NY: Free Press.
