USING WEB QUALITY MODELS AND A STRATEGY FOR PURPOSE-ORIENTED EVALUATIONS
Keywords:
Quality models, Evaluation strategy, SIQinU strategy, Quality in use, Actual usability, External quality, mprovementAbstract
Web applications and their quality evaluation has been the subject of abundant research. However, instantiated models have been used mostly for the purpose of understanding, rather than improving. In this paper, we propose utilizing a quality modeling framework together with a non-intrusive evaluation strategy to instantiate quality models with the specific purpose of not only to model and understand a Web application in-use, but also to improve it. Starting with a quality modeling framework, our approach instantiates models for both quality in use and external quality, resulting in a requirements tree for both followed by evaluation and then combined with a mechanism to develop relationships between them. Interpreting these relationships viz. ‘depends on’, and ‘influences’, in alignment with the ISO 25010 quality life cycle model, is the basis for continuous improvement. This is illustrated with a case study showing the underlying strategy from model instantiation to application improvement.
Downloads
References
Basili V., Lindvall M., Regardie M., Seaman C., Heidrich J., Munch J., Rombach D.,
Trendowicz A.: Linking software development and business strategy through measurement.
IEEE Computer, 43(4), pp. 57–65, 2010.
Becker P., Molina H., Olsina L.: Measurement and Evaluation as quality driver. In: Journal ISI
(Ingénierie des Systèmes d’Information), Special Issue “Quality of Information Systems”,
Lavoisier, Paris, France, 15(6), pp. 33-62, 2010.
Bevan N.: Extending quality in use to provide a framework for usability measurement. In: LNCS
, Springer, HCI Int’l 2009, San Diego, USA, pp. 13-22, 2009.
Bevan N., Bohomolni I.: Incorporating user quality requirements in the software development
process. In: Proceedings of 4th International Software Quality Week Europe, Brussels, pp. 1192-
, 2000.
Brambilla M., Comai S., Fraternali P., Matera M.: Designing Web Applications with WebML
and WebRatio. In: Web Engineering. Modelling and Implementing Web Applications. Springer
HCIS, Ch. 9, pp. 221-261, 2008.
Burton M., Walther J.: The value of Web log data in use-based design and testing. Journal of
Computer-Mediated Communication, 6(3), 2001.
Cappiello C., Daniel F., Koschmider A., Matera M., Picozzi M.: A Quality Model for Mashups.
In: LNCS 6757, Springer, Web Engineering, 11th Int’l Conference on Web Engineering
(ICWE2011), Auer S., Díaz O., Papadopoulos G. (Eds.), Paphos, Cyprus, pp. 137-151, 2011.
Covella G., Olsina L.: Assessing Quality in Use in a Consistent Way. In ACM proceedings, Int'l
Congress on Web Engineering, (ICWE’06), SF, USA, pp. 1-8, 2006.
Fernandez A., Insfran E., Abrahão S.: Integrating a Usability Model into a Model-Driven Web
Development Process. In: LNCS 5802, Springer, 10th International Conference on Web
Information Systems Engineering (WISE 2009), pp. 497-510, 2009.
Hassenzahl M.: User experience: towards an experiential perspective on product quality, IHM;
V.339, Proc. 20th Int’l Conference of the Assoc. Francophone d'Interaction Homme-Machine, pp
-15, 2008.
ISO/IEC 25010: Systems and software engineering. Systems and software Quality Requirements
and Evaluation (SQuaRE). System and software quality models, 2011.
ISO/IEC CD 25010.3, Systems and software engineering. Systems and software Quality
Requirements and Evaluation (SQuaRE). System and software quality models, 2009
ISO/IEC 25012: Software engineering -- Software product Quality Requirements and Evaluation
(SQuaRE) -- Data quality model, 2008
ISO/IEC 9126-1. International Standard, Software Engineering - Product Quality - Part 1:
Quality Model, 2001.
ISO 13407: User centered design process for interactive systems, 1998.
Lew P., Olsina L.: Instantiating Web Quality Models in a Purposeful Way, In: LNCS 6757,
Springer, Web Engineering, 11th Int’l Conference on Web Engineering (ICWE2011), Auer S.,
Díaz O., Papadopoulos G. (Eds.), Paphos, Cyprus, pp. 214-229, 2011.
Lew P., Olsina L., Becker P., Zhang, L.: An Integrated Strategy to Understand and Manage
Quality in Use for Web Applications. Requirements Engineering Journal, Springer, 16 (3), pp. 1-
, DOI 10.1007/s00766-011-0128-x, 2011.
Lew P., Olsina L., Zhang L.: Quality, Quality in Use, Actual Usability and User Experience as
Key Drivers for Web Application Evaluation, In: LNCS 6189, Springer, 10th Int’l Congress on
Web Engineering (ICWE2010), Vienne, Austria, pp. 218-232, 2010.
METI, Ministry of Economy - Trade and Industry - Japan, Software Metrics Advanced Project,
Investigative Report on Measure for System/Software Product Quality Requirement Definition
and Evaluation, March 2011.
Molina, H., Olsina, L.: Assessing Web Applications Consistently: A Context Information
Approach. IEEE CS, 8th Int’l Congress on Web Engineering, NY, US, pp. 224-230, 2008.
Moraga M.A, Bertoa M.F., Morcillo M.C., Calero C., Vallecillo A.: Evaluating Quality-in-Use
Using Bayesian Networks. In Proc. of QAOOSE 2008, Paphos, Cyprus, 2008.
Murugesan S.: Web Application Development: Challenges and the Role of Web Engineering.
Chap. 2 in Springer HCIS, Web Engineering: Modeling and Implementing Web Applications.
Rossi G, Pastor O, Schwabe D, Olsina L (Eds.), pp. 7-32, 2008.
Nielsen, J: Involving Stakeholders in User Testing, Jakob Nielsen's Alertbox, May 24, 2010,
Available at http://www.useit.com/alertbox/utest-observers.html, accessed in Jan, 2011
Olsina L., Sassano R., Mich L. Towards the Quality of Web 2.0 Applications, In proc. of 8th Int’l
Workshop on Web-oriented Software Technology (IWWOST 2009) held at Int’l Congress on
Web Engineering (ICWE09), San Sebastian, Spain, V. 493, pp. 3-15, CEUR (ceur-ws.org), ISSN
-0073, 2009.
Olsina L., Papa F., Molina H.: How to Measure and Evaluate Web Applications in a Consistent
Way. In: Modelling and Implementing Web Applications. Springer HCIS, Ch. 13, pp. 385–420,
Olsina L., Rossi G., Garrido A., Distante D., Canfora G.: Web Applications Refactoring and
Evaluation: A Quality-Oriented Improvement Approach, Journal of Web Engineering, Rinton
Press, US, 7 (4), pp. 258-280, 2008.
Olsina, L.; Lafuente, G. Pastor, O., Towards a Reusable Repository of Web Metrics, Journal of
Web Engineering, Rinton Press, US, 1 (1), pp. 61-73, ISSN 1540-9589, 2002.
Olsina L., Rossi G.: Measuring Web Application Quality with WebQEM, IEEE Multimedia, 9
(4), pp. 20-29, 2002.
Papa M.F. Becker P., Olsina L.: Assessing Integrated Measurement and Evaluation Strategies: A
Case Study, To appear in: IEEE Xplore proceeding: 7th Central Eastern European Software
Engineering Conference (CEE-SECR 2011), Moscow, Russia, 2011.
Prates, R., de Souza, C.; Barbosa, S.: A method for communicability evaluation of user
interfaces. Interactions, ACM, 7(1), pp. 31-3, 2000.
SPEM. Software Process Engineering Metamodel Specification. Doc./02-11-14., Ver.1.0, 2002.
