UPDATING QUALITY MODELS FOR EVALUATING NEW GENERATION WEB APPLICATIONS
Keywords:
Quality models, Quality in use, Actual usability, User Experience, Functional quality, Information quality, Evaluation approachAbstract
Web applications (WebApps) and their quality specification and evaluation have been the subject of abundant research. However, the particular features of new generation WebApps pose new challenges regarding current quality models and their included characteristics and sub-characteristics. For instance, functional added value (e.g. integratedness and beneficialness), learnability in use, communicability, sense of community and, ultimately, user experience are characteristics very often neglected in quality modeling or placed appropriately in quality views. Considering the recently issued ISO 25010/25012 standards and quality models for WebApps, in this work we propose updating our previously developed quality models and framework so-called 2Q2U (Quality, Quality in use, actual Usability and User experience) in the light of those features of new generation WebApps. The resulting quality models and framework in conjunction with evaluation strategies contribute towards a flexible, integrated approach to measure and evaluate different eras of WebApps. In order to illustrate the approach a practical case for evaluating a mashup WebApp is conducted.
Downloads
References
Abran A., Surya W., Khelifi A., Rilling J., Seffah A., Robert F.: Consolidating the ISO
Usability Models. 11th annual Int’l Software Quality Management Conference, 2003.
Becker P., Molina H., Olsina L.: Measurement and Evaluation as quality driver. In: Journal ISI
(Ingénierie des Systèmes d’Information), Special Issue “Quality of Information Systems”,
Lavoisier, Paris, France, 15(6), pp. 33-62, 2010.
Bevan N.: Extending quality in use to provide a framework for usability measurement. In:
LNCS 5619, Springer, HCI Int’l 2009, San Diego, USA, pp. 13-22, 2009.
Bevan N.: Classifying and selecting UX and usability measures, In Proc. of the 5th COST294-
MAUSE Workshop on Meaningful Measures: Valid Useful User Experience Measurement,
Cappiello C., Daniel F., Koschmider A., Matera M., Picozzi M.: A Quality Model for Mashups.
In: LNCS 6757, Springer, Web Engineering, 11th Int’l Conference on Web Engineering
(ICWE2011), Auer S., Díaz O., Papadopoulos G. (Eds.), Paphos, Cyprus, pp. 137-151, 2011.
Cappiello C., Daniel F., Matera M., Pautasso C.: Information quality in mashups. IEEE Internet
Computing, 14(4), pp. 14-22, 2010.
Grossman T, Fitzmaurice G, Attar R.: A survey of software learnability: metrics,
methodologies and guidelines, Proceedings of the 27th Int’l Conference on Human factors in
computing systems, pp. 649-658, 2009.
Hassenzahl M.: User experience: towards an experiential perspective on product quality, IHM;
V.339, Proc. 20th Int’l Conference of the Assoc. Francophone d'Interaction Homme-Machine,
pp. 11-15, 2008.
Herrera M., Moraga M.A, Caballero I., Calero C.: Quality in Use Model for Web Portals
(QiUWeP). ICWE'10 Proceedings of the 10th international conference on Current trends in
Web Engineering, Springer, LNCS 6385 pp. 91-101, 2010.
ISO/IEC 25010: Systems and software engineering. Systems and software Quality
Requirements and Evaluation (SQuaRE). System and software quality models, 2011.
ISO/IEC CD 25010.3: Systems and software engineering. Systems and software Quality
Requirements and Evaluation (SQuaRE). System and software quality models, 2009
ISO/IEC 25012: Software engineering -- Software product Quality Requirements and
Evaluation (SQuaRE) -- Data quality model, 2008
ISO/IEC 9126-1: International Standard, Software Engineering - Product Quality - Part 1:
Quality Model, 2001.
ISO 9241-110: Ergonomics of human-system interaction, Part 110: Dialogue principles, 2006.
Lew P., Qanber Abbasi M., Rafique I., Wang X., Olsina L.: Using Web Quality Models and
Questionnaires for Web Applications Evaluation. To appear in IEEE proceedings of QUATIC,
Lisbon, Portugal, 2012.
Lew P., Olsina L., Becker P., Zhang, L.: An Integrated Strategy to Understand and Manage
Quality in Use for Web Applications. Requirements Engineering Journal, Springer, 16 (3), pp.
-32, DOI 10.1007/s00766-011-0128-x, 2011.
Lew P., Olsina L., Zhang L.: Quality, Quality in Use, Actual Usability and User Experience as
Key Drivers for Web Application Evaluation, In: LNCS 6189, Springer, 10th Int’l Congress on
Web Engineering (ICWE2010), Vienne, Austria, pp. 218-232, 2010.
METI, Ministry of Economy - Trade and Industry – Japan: Software Metrics Advanced Project,
Investigative Report on Measure for System/Software Product Quality Requirement Definition
and Evaluation, March 2011.
Molina H., Olsina L.: Assessing Web Applications Consistently: A Context Information
Approach. IEEE CS, 8th Int’l Congress on Web Engineering, NY, US, pp. 224-230, 2008.
Murugesan, S.: Web X.0: A Road Map, Handbook of Research on Web 2.0, 3.0, and X.0:
Technologies, Business, and Social Applications, Murugesan Ed., IGI Global, pp. 1-11, 2010.
Nielsen J: Mobile Usability Update, Jakob Nielsen's Alertbox, Sep 26, 2011, Available at
http://www.useit.com/alertbox/mobile-usability.html, accessed by Dec, 2011
Olsina L., Lew P., Dieser A., Rivera B.: Using Web Quality Models and a Strategy for
Purpose-Oriented Evaluations, Journal of Web Engineering, Rinton Press, US, 10 (4), pp. 316-
, 2011.
Olsina L., Sassano R., Mich L: Towards the Quality of Web 2.0 Applications, In proc. of 8th
Int’l Workshop on Web-oriented Software Technology (IWWOST 2009) held at Int’l Congress
on Web Engineering (ICWE09), San Sebastian, Spain, V. 493, pp. 3-15, CEUR (ceur-ws.org),
ISSN 1613-0073, 2009.
Olsina L., Papa F., Molina H.: How to Measure and Evaluate Web Applications in a Consistent
Way. Ch. 13 in: Modelling and Implementing Web Applications, Rossi G., Pastor O., Schwabe
D. & Olsina L. (Eds), Springer-Verlag HCIS, London, pp. 385–420, 2008.
Olsina L., Lafuente G., Pastor O.: Towards a Reusable Repository of Web Metrics, Journal of
Web Engineering, Rinton Press, US, 1 (1), pp. 61-73, 2002.
Prates R., de Souza C., Barbosa S.: A method for communicability evaluation of user
interfaces. Interactions, ACM, 7(1), pp. 31-3, 2000.
Rossi G., Urbieta M., Ginzburg J., Distante D., Garrido A.: Refactoring to Rich Internet
Applications. A Model-Driven Approach. In: IEEE proceedings of 8th Int’l Congress on Web
Engineering (ICWE’08), NY, USA, pp. 1-12, 2008
Santos P. J., Badre A. N.: Discount Learnability Evaluation. Graphics, Visualization &
Usability Center, Georgia Institute of Technology, 1995, available at
http://smartech.gatech.edu/bitstream/1853/3574/1/95-30.pdf, accessed by 2011/12/01
