QUALITY VIEWS AND STRATEGY PATTERNS FOR EVALUATING AND IMPROVING QUALITY: USABILITY AND USER EXPERIENCE CASE STUDIES
Keywords:
Quality Views, Strategy Patterns, Evaluation, Improvement, UsabilityAbstract
Nowadays, software and web organizations are immersed in very competitive markets. This situation challenges organizations for paying special attention to the quality of applications and services offered to consumers. For those that frequently carry out quality assurance activities devoted to measurement, evaluation (ME) and change/improvement (MEC) projects, wellfounded quality evaluation and improvement approaches can be a key competitive issue. In this direction, we have developed an integrated quality approach whose architecture is based on quality views, and ME/MEC strategies. In order to bolster the former aspect, we specify, in this work, an ontology for quality views. Quality views and their ‘influences’ and ‘depends on’ relationships between them, are paramount for defining and selecting evaluation and improvement strategy patterns and ultimately specific strategies to be used in ME/MEC projects. A strategy pattern is a reusable solution to recurrent problems in MEC projects. For a project goal, the selected strategy pattern allows one to instantiate a specific strategy, which embraces a set of tailored activities and methods for measurement, evaluation, analysis and change for improvement. Also we discuss a set of strategy patterns and document two patterns, which were used in two case studies for understanding and improving Usability and User Experience.
Downloads
References
Alexander C: The Timeless Way of Building. Oxford University Press, (1979)
Basili V., Lindvall M., Regardie M., Seaman C., Heidrich J., Jurgen M., Rombach D.,Trendowicz A.:
Linking Software Development and Business Strategy through Measurement. IEEE Computer, 43(4), pp. 57–
, (2010)
Basili V., Caldiera G., Rombach H. D.: The Goal Question Metric Approach. In: Encyclopedia of Software
Engineering, (1), pp 528-532, (1994)
Basili V.: Software Development: A Paradigm for the Future. Proceedings of the 13th Annual International
Computer Software & Applications Conference (COMPSAC), Keynote Address, Orlando, FL, (1989)
Baskerville R., Levine L., Pries-Heje J., Ramesh B., Slaughter S.: How Internet Companies Negotiate
Quality, IEEE Computer 34(5), pp. 51-57, (2001)
Becker P., Papa F., Olsina L.: Process Ontology Specification for Enhancing the Process Compliance of a
Measurement and Evaluation Strategy. In CLEI Electronic Journal 18(1), pp. 1-26. ISSN 0717-5000, (2015)
Bevan N.: Extending Quality in Use to provide a Framework for Usability Measurement. LNCS 5619,
Springer, HCI Int’l 2009, San Diego, USA, pp. 13-22, (2009)
Briand L., Morasca S., Basili V.: Property-based Software Engineering Measurement. IEEE Trans. on
Software Engineering, Vol. 22, pp.68-86, (1996)
CMMI Product Team. CMMI for Development, Version 1.3 (CMU/SEI-2010-TR-033). Pittsburgh, PA:
Software Engineering Institute, Carnegie Mellon University, (2010)
Crowley J., Coutaz J., Rey G., Reignier P.: Perceptual Components for Context Aware Computing. 4th Int'l
Conference on Ubiquitous Computing (UbiComp '02), Borriello G. and Holmquist L. (Eds.), Springer-
Verlag, London, UK, pp. 117-134, (2002)
Curtis B., Kellner M., Over J.: Process Modelling. Com. of ACM, 35:(9), pp.75-90, (1992)
Fernández-López M., Gómez-Pérez A., Juristo N.: METHONTOLOGY: From Ontological Art Towards
Ontological Engineering. Spring Symposium on Ontological Engineering of AAAI, Stanford University,
California, pp. 33-40, (1997)
Folmer E., Bosch J.: Experiences with Software Architecture Analysis of Usability. International Journal of
Information Technology and Web Engineering, 3:(4),pp.1-29, (2008)
Folmer E., van Gurp J., Bosch J.: A Framework for Capturing the Relationship between Usability and
Software Architecture. In Software Process: Improvement and Practice, Vol. 8, pp. 67-87, (2003).
Gamma E., Helm R., Johnson R.,Vlissides J.: Design Patterns: Elements of Reusable Object-Oriented
Software. Addisson-Wesley, ISBN 0-201-63361-2, (1995)
Garvin D.: What does ‘Product Quality’ Really Mean?. Sloan Management Review, Fall, pp. 25-45, (1984)
Gruber T.R.: A Translation Approach to Portable Ontologies. Knowledge Acquisition, 5:(2), pp. 199-220,
(1993)
Guizzardi G., Baião F., Lopes M., Falbo R.: The Role of Foundational Ontologies for Domain Ontology
Engineering: An Industrial Case Study in the Domain of Oil and Gas Exploration and Production. Int. J. Inf.
Syst. Model. Des. 1, 2 (April 2010), pp. 1-22, (2010)
Hassenzahl M.: User Experience: towards an experiential perspective on product quality. In: 20th Int’l
Conference of the Assoc. Francophone d'IHM; Vol. 339, pp. 11-15, (2008)
Heo J., Ham D-H., Park S., Song C., Chul W.: A Framework for Evaluating the Usability of Mobile Phones
based on Multi-level, Hierarchical Model of Usability Factors. Interacting with Computers, Elsevier. 21:(4),
pp. 263-275, (2009)
ISO/IEC 25010: Systems and Software Engineering - Systems and Software Quality Requirements and
Evaluation (SQuaRE) - System and Software Quality Models, (2011)
ISO/IEC 9126-1: Software Engineering Product Quality - Part 1: Quality Model, (2001)
Kitchenham B., Hughes R., Linkman S.: Modeling Software Measurement Data. IEEE Transactions on
Software Engineering. (27):9, pp. 788-804, (2001)
Law E., Abrahão S.: Interplay between User Experience (UX) Evaluation and System Development. In: Int'l.
Journal of Human Computer Studies, 72(6): pp- 523-525, (2014)
Lew P., Qanber A. M., Rafique I., Wang X., Olsina L.: Using Web Quality Models and Questionnaires for
Web Applications Evaluation. IEEE proc. QUATIC, pp. 20-29, (2012)
Lew P., Olsina L., Becker P., Zhang L.: An Integrated Strategy to Systematically Understand and Manage
Quality in Use for Web Applications. Requirements Engineering Journal, Springer London, 17:(4), pp. 299-
, (2012)
Lindvall M., Donzelli P., Asgari S., Basili V.: Towards Reusable Measurement Patterns, 11th IEEE Int’l
Symposium in Software Metrics, pp. 1-8, (2005)
McGarry, J., Card, D., Jones, C., Layman, B., Clark, E., Dean, J., et al.: Practical Software Measurement:
Objective Information for Decision Makers. Addison-Wesley Professional. ISBN-13: 978-0-201-71516-3,
(2001)
Moraga M.A, Bertoa M.F., Morcillo M.C., Calero C., Vallecillo A.: Evaluating Quality-in-Use Using
Bayesian Networks. In QAOOSE 2008, Paphos, Cyprus, pp 1-10, (2008)
Morasca S.: Software Measurement, Università dell'Insubria, Como, Italy, Reading Mater-1999, available at
/morasca-handbook.pdf, Accessed 2016-01-19
Nielsen, J., Budiu, R.: Mobile Usability, New Riders, Berkeley CA, (2012)
OMG-UML. Unified Modeling Language Specification, Version 2.0. (2005)
Olsina L., Santos L., Lew P.: Evaluating Mobileapp Usability: A Holistic Quality Approach. In: 14th Int’l
Conference on Web Engineering, ICWE 2014, S. Casteleyn, G. Rossi, and M. Winckler (Eds.): Springer,
LNCS 8541, pp. 111-129, (2014)
Olsina L., Lew P., Dieser A., Rivera B.: Updating Quality Models for Evaluating New Generation Web
Applications. In Journal of Web Engineering, Special issue: Quality in new generation Web applications,
Abrahão S., Cachero C., Cappiello C., Matera M. (Eds.), Rinton Press, USA, 11:(3), pp. 209-246, (2012)
Olsina L., Papa F., Molina H.: How to Measure and Evaluate Web Applications in a Consistent Way. HCIS
Springer book Web Engineering: Modeling and Implementing Web Applications; Rossi G., Pastor O.,
Schwabe D., and Olsina L. (Eds.), pp. 385-420, (2008)
Olsina L., Rossi G., Garrido A., Distante D., Canfora G.: Web Applications Refactoring and Evaluation: A
Quality-Oriented Improvement Approach. In: Journal of Web Engineering, Rinton Press, US, 7:(4), pp. 258-
, (2008)
Papa M.F.: Toward the Improvement of a Measurement and Evaluation Strategy from a Comparative Study.
In LNCS 7703, Springer: Current Trends in Web Engineering, ICWE Int’l Workshops, Grossniklauss M. and
Wimmer M. (Eds.), pp. 189-203, (2012)
Rodríguez M.; Genero M.; Torre D.; Blasco B.; Piattini M. : A Methodology for Continuous Quality
Assessment of Software Artefacts. 10th International Conference on Quality Software (QSIC 2010), pp. 254-
, (2010)
van Heijst G., Schreiber A.T., Wielinga B.J.: Using Explicit Ontologies in KBS Development. International
Journal of Human-Computer Studies, 46, pp.183-292, Academic Press, Inc. Duluth, MN,USA, (1997)
