• BELEN RIVERA GIDIS_Web, School of Engineering, National University of La Pampa General Pico, La Pampa 6360, Argentina
  • PABLO BECKER GIDIS_Web, School of Engineering, National University of La Pampa General Pico, La Pampa 6360, Argentina
  • LUIS OLSINA GIDIS_Web, School of Engineering, National University of La Pampa General Pico, La Pampa 6360, Argentina


Quality Views, Strategy Patterns, Evaluation, Improvement, Usability


Nowadays, software and web organizations are immersed in very competitive markets. This situation challenges organizations for paying special attention to the quality of applications and services offered to consumers. For those that frequently carry out quality assurance activities devoted to measurement, evaluation (ME) and change/improvement (MEC) projects, wellfounded quality evaluation and improvement approaches can be a key competitive issue. In this direction, we have developed an integrated quality approach whose architecture is based on quality views, and ME/MEC strategies. In order to bolster the former aspect, we specify, in this work, an ontology for quality views. Quality views and their ‘influences’ and ‘depends on’ relationships between them, are paramount for defining and selecting evaluation and improvement strategy patterns and ultimately specific strategies to be used in ME/MEC projects. A strategy pattern is a reusable solution to recurrent problems in MEC projects. For a project goal, the selected strategy pattern allows one to instantiate a specific strategy, which embraces a set of tailored activities and methods for measurement, evaluation, analysis and change for improvement. Also we discuss a set of strategy patterns and document two patterns, which were used in two case studies for understanding and improving Usability and User Experience.



Download data is not yet available.


Alexander C: The Timeless Way of Building. Oxford University Press, (1979)

Basili V., Lindvall M., Regardie M., Seaman C., Heidrich J., Jurgen M., Rombach D.,Trendowicz A.:

Linking Software Development and Business Strategy through Measurement. IEEE Computer, 43(4), pp. 57–

, (2010)

Basili V., Caldiera G., Rombach H. D.: The Goal Question Metric Approach. In: Encyclopedia of Software

Engineering, (1), pp 528-532, (1994)

Basili V.: Software Development: A Paradigm for the Future. Proceedings of the 13th Annual International

Computer Software & Applications Conference (COMPSAC), Keynote Address, Orlando, FL, (1989)

Baskerville R., Levine L., Pries-Heje J., Ramesh B., Slaughter S.: How Internet Companies Negotiate

Quality, IEEE Computer 34(5), pp. 51-57, (2001)

Becker P., Papa F., Olsina L.: Process Ontology Specification for Enhancing the Process Compliance of a

Measurement and Evaluation Strategy. In CLEI Electronic Journal 18(1), pp. 1-26. ISSN 0717-5000, (2015)

Bevan N.: Extending Quality in Use to provide a Framework for Usability Measurement. LNCS 5619,

Springer, HCI Int’l 2009, San Diego, USA, pp. 13-22, (2009)

Briand L., Morasca S., Basili V.: Property-based Software Engineering Measurement. IEEE Trans. on

Software Engineering, Vol. 22, pp.68-86, (1996)

CMMI Product Team. CMMI for Development, Version 1.3 (CMU/SEI-2010-TR-033). Pittsburgh, PA:

Software Engineering Institute, Carnegie Mellon University, (2010)

Crowley J., Coutaz J., Rey G., Reignier P.: Perceptual Components for Context Aware Computing. 4th Int'l

Conference on Ubiquitous Computing (UbiComp '02), Borriello G. and Holmquist L. (Eds.), Springer-

Verlag, London, UK, pp. 117-134, (2002)

Curtis B., Kellner M., Over J.: Process Modelling. Com. of ACM, 35:(9), pp.75-90, (1992)

Fernández-López M., Gómez-Pérez A., Juristo N.: METHONTOLOGY: From Ontological Art Towards

Ontological Engineering. Spring Symposium on Ontological Engineering of AAAI, Stanford University,

California, pp. 33-40, (1997)

Folmer E., Bosch J.: Experiences with Software Architecture Analysis of Usability. International Journal of

Information Technology and Web Engineering, 3:(4),pp.1-29, (2008)

Folmer E., van Gurp J., Bosch J.: A Framework for Capturing the Relationship between Usability and

Software Architecture. In Software Process: Improvement and Practice, Vol. 8, pp. 67-87, (2003).

Gamma E., Helm R., Johnson R.,Vlissides J.: Design Patterns: Elements of Reusable Object-Oriented

Software. Addisson-Wesley, ISBN 0-201-63361-2, (1995)

Garvin D.: What does ‘Product Quality’ Really Mean?. Sloan Management Review, Fall, pp. 25-45, (1984)

Gruber T.R.: A Translation Approach to Portable Ontologies. Knowledge Acquisition, 5:(2), pp. 199-220,


Guizzardi G., Baião F., Lopes M., Falbo R.: The Role of Foundational Ontologies for Domain Ontology

Engineering: An Industrial Case Study in the Domain of Oil and Gas Exploration and Production. Int. J. Inf.

Syst. Model. Des. 1, 2 (April 2010), pp. 1-22, (2010)

Hassenzahl M.: User Experience: towards an experiential perspective on product quality. In: 20th Int’l

Conference of the Assoc. Francophone d'IHM; Vol. 339, pp. 11-15, (2008)

Heo J., Ham D-H., Park S., Song C., Chul W.: A Framework for Evaluating the Usability of Mobile Phones

based on Multi-level, Hierarchical Model of Usability Factors. Interacting with Computers, Elsevier. 21:(4),

pp. 263-275, (2009)

ISO/IEC 25010: Systems and Software Engineering - Systems and Software Quality Requirements and

Evaluation (SQuaRE) - System and Software Quality Models, (2011)

ISO/IEC 9126-1: Software Engineering Product Quality - Part 1: Quality Model, (2001)

Kitchenham B., Hughes R., Linkman S.: Modeling Software Measurement Data. IEEE Transactions on

Software Engineering. (27):9, pp. 788-804, (2001)

Law E., Abrahão S.: Interplay between User Experience (UX) Evaluation and System Development. In: Int'l.

Journal of Human Computer Studies, 72(6): pp- 523-525, (2014)

Lew P., Qanber A. M., Rafique I., Wang X., Olsina L.: Using Web Quality Models and Questionnaires for

Web Applications Evaluation. IEEE proc. QUATIC, pp. 20-29, (2012)

Lew P., Olsina L., Becker P., Zhang L.: An Integrated Strategy to Systematically Understand and Manage

Quality in Use for Web Applications. Requirements Engineering Journal, Springer London, 17:(4), pp. 299-

, (2012)

Lindvall M., Donzelli P., Asgari S., Basili V.: Towards Reusable Measurement Patterns, 11th IEEE Int’l

Symposium in Software Metrics, pp. 1-8, (2005)

McGarry, J., Card, D., Jones, C., Layman, B., Clark, E., Dean, J., et al.: Practical Software Measurement:

Objective Information for Decision Makers. Addison-Wesley Professional. ISBN-13: 978-0-201-71516-3,


Moraga M.A, Bertoa M.F., Morcillo M.C., Calero C., Vallecillo A.: Evaluating Quality-in-Use Using

Bayesian Networks. In QAOOSE 2008, Paphos, Cyprus, pp 1-10, (2008)

Morasca S.: Software Measurement, Università dell'Insubria, Como, Italy, Reading Mater-1999, available at


/morasca-handbook.pdf, Accessed 2016-01-19

Nielsen, J., Budiu, R.: Mobile Usability, New Riders, Berkeley CA, (2012)

OMG-UML. Unified Modeling Language Specification, Version 2.0. (2005)

Olsina L., Santos L., Lew P.: Evaluating Mobileapp Usability: A Holistic Quality Approach. In: 14th Int’l

Conference on Web Engineering, ICWE 2014, S. Casteleyn, G. Rossi, and M. Winckler (Eds.): Springer,

LNCS 8541, pp. 111-129, (2014)

Olsina L., Lew P., Dieser A., Rivera B.: Updating Quality Models for Evaluating New Generation Web

Applications. In Journal of Web Engineering, Special issue: Quality in new generation Web applications,

Abrahão S., Cachero C., Cappiello C., Matera M. (Eds.), Rinton Press, USA, 11:(3), pp. 209-246, (2012)

Olsina L., Papa F., Molina H.: How to Measure and Evaluate Web Applications in a Consistent Way. HCIS

Springer book Web Engineering: Modeling and Implementing Web Applications; Rossi G., Pastor O.,

Schwabe D., and Olsina L. (Eds.), pp. 385-420, (2008)

Olsina L., Rossi G., Garrido A., Distante D., Canfora G.: Web Applications Refactoring and Evaluation: A

Quality-Oriented Improvement Approach. In: Journal of Web Engineering, Rinton Press, US, 7:(4), pp. 258-

, (2008)

Papa M.F.: Toward the Improvement of a Measurement and Evaluation Strategy from a Comparative Study.

In LNCS 7703, Springer: Current Trends in Web Engineering, ICWE Int’l Workshops, Grossniklauss M. and

Wimmer M. (Eds.), pp. 189-203, (2012)

Rodríguez M.; Genero M.; Torre D.; Blasco B.; Piattini M. : A Methodology for Continuous Quality

Assessment of Software Artefacts. 10th International Conference on Quality Software (QSIC 2010), pp. 254-

, (2010)

van Heijst G., Schreiber A.T., Wielinga B.J.: Using Explicit Ontologies in KBS Development. International

Journal of Human-Computer Studies, 46, pp.183-292, Academic Press, Inc. Duluth, MN,USA, (1997)