An MDA Proposal To Integrate the Measurement Lifecycle Into the Process Lifecycle
DOI:
https://doi.org/10.13052/jwe1540-9589.2074Abstract
Context: Measuring the Software Development Process (SDP) supports organizations in their endeavor to understand, manage, and improve their development processes and projects. In the last decades, the SDP has evolved to meet the market needs and keep abreast of modern technologies and infrastructures. These changes in the development processes have increased the importance of the measurement and caused changes in the measurement process and the used measures. Objective: This work aims to develop a solution to support the measurement activities throughout the process lifecycle. Method: Study the current state of the art to identify existing gaps. Then, propose a solution to support the process measurement throughout the SDP lifecycle. Results: The proposed solution consists of two main components: (i) Measurement lifecycle, which defines the measurement activities throughout the SDP lifecycle, (ii) Measurement definition metamodel (MDMM), which supports the measurement lifecycle and its integration into the process lifecycle. Conclusion: This proposal allows organizations to define, manage, and improve their processes; the proposed information model supports the unification of the measurement concepts and vocabulary. The defined measurement lifecycle provides a comprehensive guide for the organizations to establish the measurement objectives and carry out the necessary activities to achieve them. The proposed MDMM supports and guides the engineers in the complete and operational definition of the measurement concepts.
Downloads
References
N. E. Fenton, Software metrics: a rigorous approach. Chapman & Hall, 1991.
B. Kitchenham and S. L. Pfleeger, “Software quality: The elusive target,” IEEE Softw., vol. 13, no. 1, p. 12, 1996.
A. Fuggetta, “Software process: a roadmap,” in Proceedings of the Conference on the Future of Software Engineering, 2000, pp. 25–34.
G. Cugola and C. Ghezzi, “Software Processes: a Retrospective and a Path to the Future,” Softw. Process Improv. Pract., 1998, [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1. 1.17.2499&rep=rep1&type=pdf.
F. García et al., “Towards a consistent terminology for software measurement,” Inf. Softw. Technol., vol. 48, no. 8, pp. 631–644, 2006. [6] M. Bourgault, E. Lefebvre, L. A. Lefebvre, R. Pellerin, and E. Elia, “Discussion of metrics for distributed project management: Preliminary findings,” in System Sciences, 2002. HICSS. Proceedings of the 35th
Annual Hawaii International Conference on, 2002, pp. 10–pp.
M. Tihinen, R. Kommeren, D. Systems, J. Rotherham, and P. M. Office, “Metrics and Measurements in Global Software Development,” Int. J. Adv. Softw., vol. 5, no. 3, pp. 278–292, 2012.
S. K. Bang, S. Chung, Y. Choh, and M. Dupuis, “A grounded theory analysis of modern web applications: knowledge, skills, and abilities for DevOps,” in Proceedings of the 2nd annual conference on Research in information technology, 2013, pp. 61–62.
D. C. Schmidt, “Model-driven engineering,” Comput. Comput. Soc., vol. 39, no. 2, p. 25, 2006.
A. Meidan, J. A. García-García, M. J. Escalona, and I. Ramos, “A survey on business processes management suites,” Comput. Stand. Interfaces, 2016, doi: 10.1016/j.csi.2016.06.003.
A. Meidan, J. A. García-García, I. Ramos, and M. J. Escalona, “Measuring Software Process: A Systematic Mapping Study,” ACM Comput. Surv., vol. 51, no. 3, pp. 58:1–58:32, 2018, doi: 10.1145/3186888.
R. Bendraou, M.-P. Gervais, and X. Blanc, “UML4SPM: An executable software process modeling language providing high-level abstractions,” in Enterprise Distributed Object Computing Conference, 2006. EDOC’06. 10th IEEE International, 2006, pp. 297–306.
B. Mora, M. Piattini, F. Ruiz, and F. Garcia, “Smml: Software measurement modeling language,” in Proceedings of the 8th Workshop on Domain-Specific Modeling (DSM’2008), 2008.
B. Mora, F. Garcia, F. Ruiz, and M. Piattini, “Model-driven software measurement framework: A case study,” in Quality Software, 2009. QSIC’09. 9th International Conference on, 2009, pp. 239–248.
B. Mora et al., “Software generic measurement framework based on MDA,” IEEE Lat. Am. Trans., vol. 6, no. 4, pp. 363–370, 2008.
Y. Singh and M. Sood, “Model Driven Architecture: A Perspective,” Adv. Comput. Conf. 2009. IACC 2009. IEEE Int., no. March, pp. 1644–1652, 2009, doi: 10.1109/IADCC.2009.4809264.
X. Larrucea and E. Iturbe, “A Metamodel Integration for Metrics and Processes Correlation.,” in ICSOFT, 2010, pp. 63–68.
O. M. GROUP, “Software Metrics Metamodel,” 2009. [Online]. Available: http://www.omg.org/spec/SMM/1.0/Beta1/PDF/.
OMG, “SPEM 2.0 Software & Systems Process Engineering Metamodel specification,” 2002. [Online]. Available: http://www.omg.org/spec/SPEM/.
M. A. Freire, F. A. Aleixo, U. Kulesza, E. Aranha, and R. Coelho, “Automatic Deployment and Monitoring of Software Processes: A Model-Driven Approach.,” in SEKE, 2011, pp. 42–47.
A. Del-Río-Ortega, M. Resinas, C. Cabanillas, and A. Ruiz-Cortés, “On the definition and design-time analysis of process performance indicators,” Inf. Syst., vol. 38, no. 4, pp. 470–490, 2013.
J. A. García García, M. J. Escalona, A. Martínez-García, C. Parra, and T. Wojdyñski, “Clinical Process Management: A model-driven & toolbased proposal,” 2015.
J. A. Garcia-Garcia, “Una propuesta para el uso del paradigma guiado por modelos (MDE) para la definición y ejecución de procesos de negocios,” Sevilla, 2015.
T. Allweyer, “Business Process Model and Notation (BPMN) Version 2.0,” 2015, doi: 10.1007/s11576-008-0096-z.
Bonitasoft, “Bonitasoft,” 2016. http://www.bonitasoft.com/.
Eclipse, “Eclipse Process Framework Project |projects.eclipse.org,” 2017. https://projects.eclipse.org/projects/technology.epf.
IBM, “IBM – Rational Method Composer,” 2017. http://www-03.ibm.c om/software/products/en/rmc.
J. B. Hill, J. Sinur, D. Flint, and M. J. Melenovsky, “Gartner’s position on business process management,” Gart. Res. G, vol. 136533, 2006.
W. M. P. van der Aalst, “Business Process Management Demystified: A Tutorial on Models, Systems and Standards for Workflow Management,” Springer, Berlin, Heidelberg, 2004, pp. 1–65.
W. M. P. van der Aalst, “Business process management: a personal view,” Bus. Process Manag. J., vol. 10, no. 2, p. bpmj.2004.15710 baa.001, Apr. 2004, doi: 10.1108/bpmj.2004.15710baa.001.
N. Habra, A. Abran, M. Lopez, and A. Sellami, “A framework for the design and verification of software measurement methods,” J. Syst. Softw., vol. 81, no. 5, pp. 633–648, 2008.
ISO/IEC/IEEE 15288-Systems and software engineering System life cycle processes, vol. 15288. 2015.
ISO/IEC/IEEE 12207-2017-International Standard – Systems and software engineering – Software life cycle processes. 2017.
J.-P. Jacquet and A. Abran, “From software metrics to software measurement methods: a process model,” in Proceedings of IEEE International Symposium on Software Engineering Standards, 1997, pp. 128–135, doi:
1109/SESS.1997.595954.
Y. Zhang and D. Sheth, “Mining software repositories for modeldriven development,” IEEE Softw., vol. 23, no. 1, pp. 82–90, 2006, doi: 10.1109/MS.2006.23.
A. Del-Río-Ortega, M. Resinas, and A. Ruiz-Cortés, “Towards modelling and tracing key performance indicators in business processes,” II Taller sobre Procesos Neg. e Ing. Serv. PNIS, 2009.
“ISO/IEC/IEEE 15939-2017 International Standard – Systems and software engineering–Measurement process,” pp. 1–49, 2017, doi: 10.1109/IEEESTD.2017.7907158.
J. McGarry, Practical software measurement: objective information for decision makers. Addison-Wesley Professional, 2002.
B. A. Kitchenham, R. T. Hughes, and S. G. Linkman, “Modeling software measurement data,” IEEE Trans. Softw. Eng., vol. 27, no. 9, pp. 788–804, 2001.
M. P. Barcellos, R. de Almeida Falbo, and A. R. Rocha, “A strategy for preparing software organizations for statistical process control,” J. Brazilian Comput. Soc., vol. 19, no. 4, pp. 445–473, Nov. 2013, doi:
1007/s13173-013-0106-x.
W. Bandara, G. G. Gable, and M. Rosemann, “Factors and measures of business process modelling: model building through a multiple case study,” Eur. J. Inf. Syst., vol. 14, no. 4, pp. 347–360, Dec. 2005, doi:
1057/palgrave.ejis.3000546.
L. García-Borgoñon, J. A. García-García, M. Alba, and M. J. Escalona, “Software Process Management: A Model-Based Approach,” in Building Sustainable Information Systems, Boston, MA: Springer US, 2013, pp. 167–178.
J. A. Garcia-Garcia, A. Meidan, A. Vázquez Carreño, and M. Mejias Risoto, “A Model-Driven Proposal to Execute and Orchestrate Processes: PLM4BS,” Springer, Cham, 2017, pp. 211–225.
M. J. Escalona, “Modelos y técnicas para la especificación y el análisis de la navegación en sistemas software,” University of Seville, 2004.
M. Escalona and G. Aragon, “NDT. A Model-Driven Approach for Web Requirements,” IEEE Trans. Softw. Eng., vol. 34, no. 3, pp. 377–390, May 2008, doi: 10.1109/TSE.2008.27.
V. Popova and A. Sharpanskykh, “Modeling organizational performance indicators,” Inf. Syst., vol. 35, no. 4, pp. 505–527, 2010, doi: 10.1016/j.is.2009.12.001.
N. E. Fenton and S. L. Pfleeger, Software metrics: a rigorous and practical approach, Second Edi. London: International Thomson Computer Press, 1996.
B. Kitchenham, S. L. Pfleeger, and N. Fenton, “Towards a framework for software measurement validation,” IEEE Trans. Softw. Eng., vol. 21, no. 12, pp. 929–944, 1995.
J. N. Martin, “Architecture Definition – A New Process in the ISO International Systems Engineering Standard,” INCOSE Int. Symp., vol. 25, no. 1, pp. 463–472, Oct. 2015, doi: 10.1002/j.2334-5837.2015.00075.x.
C. A. Dekkers and P. A. McQuaid, “The dangers of using software metrics to (mis)manage,” IT Prof., vol. 4, no. 2, pp. 24–30, Mar. 2002, doi: 10.1109/MITP.2002.1000457.
F. Ruiz-gonzález and G. Canfora, “Software Process: Characteristics, Technology and Environments,” CEPIS-UPGRADE, vol. V, no. 5, pp. 5–10, 2004.
T. Tahir, G. Rasool, and C. Gencel, “A systematic literature review on software measurement programs,” Inf. Softw. Technol., vol. 73, pp. 101–121, 2016, doi: 10.1016/j.infsof.2016.01.014.
L. C. Briand, S. Morasca, and V. R. Basili, “An operational process for goal-driven definition of measures,” IEEE Trans. Softw. Eng., vol. 28, no. 12, pp. 1106–1125, Dec. 2002, doi: 10.1109/TSE.2002.1158285.
M. Kasunic, “The State of Software Measurement Practice: Results of 2006 Survey,” Pittsburgh, PA, 2006. [Online]. Available: http://resource s.sei.cmu.edu/library/asset-view.cfm?AssetID=8095.
L. Sánchez González, F. García Rubio, F. Ruiz González, and M. Piattini Velthuis, “Measurement in business processes: a systematic review,” Bus. Process Manag. J., vol. 16, no. 1, pp. 114–134, Feb. 2010, doi:
1108/14637151011017976.
H. Zhang, J. Keung, B. Kitchenham, and R. Jeffery, “Semi-quantitative Modeling for Managing Software Development Processes,” in 19th Australian Conference on Software Engineering (aswec 2008), Mar. 2008,
pp. 66–75, doi: 10.1109/ASWEC.2008.4483194.
T. Magennis, “The Economic Impact of Software Development Process Choice – Cycle-Time Analysis and Monte Carlo Simulation Results,” in 48th Hawaii International Conference on System Sciences, Jan. 2015,
pp. 5055–5064, doi: 10.1109/HICSS.2015.599.
M. Ruiz, I. Ramos, and M. Toro, “A Dynamic Integrated Framework for Software Process Improvement,” Softw. Qual. J., vol. 10, no. 2, pp. 181–194, 2002, doi: 10.1023/A:1020580008694.
J. M. Perez-Alvarez, M. T. Gomez-Lopez, L. Parody, and R. M. Gasca, “Process Instance Query Language to Include Process Performance Indicators in DMN,” in IEEE 20th International Enterprise Distributed Object Computing Workshop (EDOCW), Sep. 2016, pp. 1–8, doi: 10.1109/EDOCW.2016.7584381.
K. Hikichi, K. Fushida, H. Iida, and K. Matsumoto, “A Software Process Tailoring System Focusing to Quantitative Management Plans,” Springer, Berlin, Heidelberg, 2006, pp. 441–446.
X. Wang, A. Ren, and X. Liu, “Researching on quantitative project management plan and implementation method,” 2017, p. 020176, doi: 10.1063/1.4992993.
M. E. Kuwaiti and J. M. Kay, “The role of performance measurement in business process re-engineering,” Int. J. Oper. Prod. Manag., vol. 20, no. 12, pp. 1411–1426, Dec. 2000, doi: 10.1108/01443570010353086.
R. E. Park, W. B. Goethert, and W. A. Florac, “Goal-Driven Software Measurement. A Guidebook.,” 1996.
D. N. Card and C. L. Jones, “Status report: practical software measurement,” in Third International Conference on Quality Software, 2003. Proceedings., 2003, pp. 315–320, doi: 10.1109/QSIC.2003.1319116.
M. Staron, W. Meding, K. Niesel, and A. Abran, “A Key Performance Indicator Quality Model and Its Industrial Evaluation,” in Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement (IWSM-MENSURA), Oct. 2016, pp. 170–179, doi: 10.1109/IWSMMensura.2016.033.
M. J. Ordonez and H. M. Haddad, “The State of Metrics in Software Industry,” in Fifth International Conference on Information Technology: New Generations (itng 2008), Apr. 2008, pp. 453–458, doi: 10.1109/ITNG.2008.106.
Y. Wang et al., “Product and Process Metrics: A Software Engineering Measurement Expert System,” Springer, Berlin, Heidelberg, 2002, pp. 337–350.
M. Staron, W. Meding, J. Hansson, C. Höglund, K. Niesel, and V. Bergmann, “Dashboards for Continuous Monitoring of Quality for Software Product under Development,” in Relating System Quality and Software Architecture, Elsevier, 2014, pp. 209–229.
M. Staron, W. Meding, G. Karlsson, and C. Nilsson, “Developing measurement systems: an industrial case study,” J. Softw. Maint. Evol. Res. Pract., vol. 23, no. 2, pp. 89–107, 2011, doi: 10.1002/smr.470.
P. Berander and P. Jönsson, “A goal question metric based approach for efficient measurement framework definition,” Proc. 2006 ACM/IEEE Int. Symp. Int. Symp. Empir. Softw. Eng. – ISESE ’06, pp. 316–325, 2006,
doi: 10.1145/1159733.1159781.
K. Pandazo, A. Shollo, M. Staron, and W. Meding, “Presenting software metrics indicators: a case study,” in Proceedings of the 20th International Conference on Software Product and Process Measurement (MENSURA), 2010, vol. 20, no. 1.
D. Montgomery, Introduction to statistical quality control. 2009.
M. K. Daskalantonakis, “A practical view of software measurement and implementation experiences within Motorola,” IEEE Trans. Softw. Eng., vol. 18, no. 11, pp. 998–1010, 1992, doi: 10.1109/32.177369.
M. Staron and W. Meding, “Using models to develop measurement systems: a method and its industrial use,” Softw. Process Prod. Meas., pp. 212–226, 2009, doi: 10.1007/978-3-642-05415-0_16.
ISO/IEC 19507:2012.Information technology – Object Constraint Language (OCL). 2012.
Sparx Systems, “Full Lifecycle Modeling for Business, Software and Systems,” 2018. https://sparxsystems.com/products/ea/.
Object Management Group, “Model Driven Architecture,” 2015. [Online]. Available: http://www.omg.org/mda/specs.htm.
M. J. Escalona, J. Torres, M. Mejías, and A. Reina, “NDT-Tool: A Case Tool to Deal with Requirements in Web Information Systems,” in Web Engineering, 2003, pp. 212–213.
IBM Corporation, “IBM Rational Software Architect Designer,” 2018. https://www.ibm.com/us-en/marketplace/rational-software-architect-designer/details?mhq=RationalSoftwareModeler&mhsrc=ibmsearch_p.
A.-M. Audet, S. Greenfield, and M. Field, “Medical practice guidelines: current activities and future directions,” Ann. Intern. Med., vol. 113, no. 9, pp. 709–714, 1990.
