Capability Maturity Models as a Means to Standardize Sustainable Development Goals Indicators Data Production

Authors

  • Ignacio Marcovecchio United Nations University, Institute on Computing and Society (UNU-CS), Macau; Depto. de Ciencias e Ingeniería de la Computación, Universidad Nacional del Sur, Argentina
  • Mamello Thinyane United Nations University, Institute on Computing and Society (UNU-CS), Macau
  • Elsa Estevez Depto. de Ciencias e Ingeniería de la Computación, Universidad Nacional del Sur, Argentina; Instituto de Ciencias e Ingeniería de la Computación, CONICET, Argentina
  • Pablo Fillottrani Depto. de Ciencias e Ingeniería de la Computación, Universidad Nacional del Sur, Argentina; Comisión de Investigaciones Científicas de la Provincia de Buenos Aires, Argentina

DOI:

https://doi.org/10.13052/jicts2245-800X.633

Keywords:

Sustainable Development Goals, Capability Maturity Model, Data Revolution, Institutional Capacity

Abstract

Achieving the Sustainable Development Goals (SDGs) demands effective harnessing of the ensuing data revolution – the integration of new and traditional data to produce high-quality indicators that are detailed, timely, and actionable for multiple purposes and to a variety of users. The quality of these indicators, defined in terms of completeness, uniqueness, timeliness, validity, accuracy, and consistency, is crucial for their use in national level planning, monitoring and evaluation (PM&E) processes, for facilitating global monitoring of progress on the SDGs, and for enabling comparative evaluation between countries. The use of indicators for trans-national analyses and global-level decision making necessitates coordination, integration, and interoperation between the various stakeholders within the global data ecosystem. Various instruments, including protocols, models, frameworks, specifications, and standards are used widely to facilitate the coordination, integration, and interoperation across various global systems, such as telecommunication systems. In this paper, we posit that Capability Maturity Models (CMMs) can be an instrument and a mechanism towards not only ensuring the production of high-quality indicators data, but also for standardizing the key processes around the production of SDG indicators data, and for facilitating interoperation within the data ecosystem. This paper motivates for the adoption and mainstreaming of organizational CMMs within the SDGs activities. It also presents the preliminary formulation of a multidimensional prescriptive CMM to assess and articulate pathways towards the maturity of organizations within national data ecosystems and, therefore, the effective monitoring of the progress on the SDG targets through the production of high-quality indicators data. Furthermore, the paper provides recommendations towards addressing the challenges within the increasingly data-driven domain of social indicators monitoring.

Downloads

Download data is not yet available.

Author Biographies

Ignacio Marcovecchio, United Nations University, Institute on Computing and Society (UNU-CS), Macau; Depto. de Ciencias e Ingeniería de la Computación, Universidad Nacional del Sur, Argentina

Ignacio Marcovecchio is a Computer Scientist with almost fifteen years of experience in project and portfolio management, software development, data management, ICT administration, and multimedia development. His interests are software systems management, continuous improvement and quality assurance, and he has experience with several software development projects. Currently, he is a Senior Research Assistant at the United Nations University Institute in Computing and Society (UNU-CS), where he conducts research in the context of the Small Data Lab focusing in the improvement of quality of the SDG Indicators monitoring. Previously, Ignacio gained international experience from other UN and UNU organizations (UNU-IIST, UNW-DPC, UNU-FLORES) as well as some public and private institutions, all in the domain of research and education, where he played different roles.

Ignacio holds a Bachelor’s Degree in Systems Engineering from the National University of Central Buenos Aires, and a Master Degree in Computer Science from the National University of the South in Argentina. He is currently pursuing a PhD in Computer Science at the same institute.

Mamello Thinyane, United Nations University, Institute on Computing and Society (UNU-CS), Macau

Mamello Thinyane (PhD, 2009, Rhodes University) is passionate about technology innovation and about seeing individuals and communities empowered to lead “their happy” lives. He works within the Small Data Lab at UNU-CS investigating the role of locally-relevant, citizen-generated data to empower individuals and community-level actors towards the Sustainable Development Goals targets, as well as the role of this data within the larger social indicators data ecosystem.

Mamello is the Chairman of the board of the African Footprints of Hope Organization, an NGO that facilitates strategic multistakeholder engagements towards socio-economic development of communities in Southern Africa. He is also a Visiting Researcher at the Australian Centre of Cyber-Security at the University of New South Wales in Canberra.

Elsa Estevez, Depto. de Ciencias e Ingeniería de la Computación, Universidad Nacional del Sur, Argentina; Instituto de Ciencias e Ingeniería de la Computación, CONICET, Argentina

Elsa Estevez is a Professor at the National University of the South and at the National University of La Plata and Independent Researcher at the National Scientific and Technical Research Council (CONICET), in Argentina. She was a Senior Academic Program Officer of the United Nations University contributing to digital government research and development. It is the President of the Steering Committee of the International Conference of Theory and Practice of Electronic Governance (ICEGOV) and Associate Editor of Government Information Quarterly (GIQ), Elsevier. She has many publications and has participated in numerous international events dedicated to issues of Digital Governance. Elsa has a PhD in Computer Science from the National University of the South, Argentina.

Pablo Fillottrani, Depto. de Ciencias e Ingeniería de la Computación, Universidad Nacional del Sur, Argentina; Comisión de Investigaciones Científicas de la Provincia de Buenos Aires, Argentina

Pablo Fillottrani is a Professor at the National University of South (UNS) and Independent Researcher at the Commission of Scientific Research (CIC) of the Province of Buenos Aires. He is the Director of the Software Engineering and Information Systems Laboratory (LISSI) at UNS. He is the Director of the degree programme of Engineering in Information Systems of UNS. He has numerous publications and extensive experience in building human capacity in Computer Science. Pablo has a Ph.D. in Computer Science from the National University of the South.

References

“UN Millennium Project |About the MDGs.” [Online]. Available: http://www.unmillenniumproject.org/goals/. [Accessed: 31-Jan-2017].

“Sustainable Development Goals |UNDP.” [Online]. Available: http://www.undp.org/content/undp/en/home/sustainable-development-goals.html. [Accessed: 31-Jan-2017].

“UNSD – United Nations Statistical Commission.” [Online]. Available: http://unstats.un.org/unsd/statcom. [Accessed: 31-Jan-2017].

Thinyane, M. (2016). “Small Data for SDGs Community-Level Action and Indicators Monitoring.”

Independent Expert Advisory Group on a Data Revolution for Sustainable Development, “A World that Counts: Mobilising the Data Revolution for Sustainable Development,” 2014.

“Metrics & Indicators – Business for 2030.” [Online]. Available: http://www.businessfor2030.org/metrics-indicators/. [Accessed: 31-Jan-2017].

High-Level Panel of Eminent Persons on the Post-2015 Development Agenda, “A New Global Partnership: Eradicate Poverty and Transform Economies through Sustainable Development,” 2013.

United Nations Economic Commission for Europe (UNECE), “National Mechanisms for Providing Data on Global SDG Indicators,” 2018.

Moorosi, N., Thinyane, M., and Marivate, V. (2017). A Critical and Systemic Consideration of Data for Sustainable Development in Africa. In International Conference on Social Implications of Computers in Developing Countries (pp. 232–241). Springer, Cham.

Sustainable Development Solutions Network, “Leaving No One Behind: Disaggregating Indicators for the SDGs,” 2015.

United Nations, “Fundamental Principles of Official Statistics,” 2014.

Robinson, H., and Obuwa, D. (2006). Quality assurance of new methods in National Accounts. Econ. Trends, 629, 14–19.

Office for National Statistics United Kingdom, “Framework for National Statistics,” 2000.

European Central Bank, “ECB Statistics Quality Framework (SQF),” 2008.

“Monitoring and evaluation |Sustainable Development Goals Fund.” [Online]. Available: http://www.sdgfund.org/monitoring-and-evaluation. [Accessed: 02-Mar-2017].

Brancato, G., D’Assisi Barbalace, F., Signore, M., and Simeoni, G. (2017). Introducing a framework for process quality in National Statistical Institutes. Stat. J. IAOS, 33(2), 441–446.

Portillo, S., and Moore, K. (2016). “A systematic approach to quality: the development and implementation of a quality management framework in the Central Statistics Office, Ireland,” in European Conference on Quality in Official Statistics, 1–12.

OECD, “Quality Framework and Guidelines for OECD Statistical Activities,” 2012.

International Monetary Fund Statistics Department, (2010). “IMF’s Data Quality Assessment Framework,” in Conference on Data Quality for International Organizations, 1–11.

Dahlgaard-Park, S. M. (2015). “Total Quality Management (TQM),” SAGE Encycl. Qual. Serv. Econ., 808–812.

United Nations Statistics Division, “National Quality Assurance Framework.” [Online]. Available: https://unstats.un.org/unsd/dnss/qualitynqaf/nqaf.aspx. [Accessed: 24-Apr-2018].

Dygaszewicz, J., and Szafranski, B. (2016). “Introducing Enterprise Architecture Framework in Statistics Poland,” Comput. Sci. Math. Model., 3, 23–32.

Eurostat, “ESS EA Reference Framework,” 2015.

Lalor, T., and Gregory, A. (2015). “Common Statistical Production Architecture,” in 5th Annual European DDI User Conference, 1–50.

Koskimäki, T., and Koskinen, V. (2016). “Governmental and Statistical Enterprise Architectures as Tools for Modernizing the National Statistical System,” in European Conference on Quality in Official Statistics, 1–10.

Elena, S., Aquilino, N., and Pichón Riviére, A. (2014). Emerging Impacts in Open Data in the Judiciary Branches in Argentina, Chile and Uruguay, 1–48.

United Nations Development Group, “Common Country Assessment,” 2002.

Gómez, L. F., and Heeks, R. (2016). “Measuring the Barriers to Big Data for Development: Design-Reality Gap Analysis in Colombia’s Public Sector”.

Committee for the Coordination of Statistical Activities and Statistical Office of the European Communities, “Revised International Statistical Processes Assessment Checklist,” 2009.

Organisation for Economic Co-operation and Development, “OECD Glossary of Statistical Terms – Statistical standard Definition.” [Online]. Available: http://stats.oecd.org/glossary/detail.asp?ID=4920. [Accessed: 26-Jun-2017].

Giacalone, M., and Scippacercola, S. (2016). “Big Data: Issues and an Overview in Some Strategic Sectors,” J. Appl. Quant. Methods, 11(3), 1–18.

Office for National Statistics United Kingdom, “National Statistics Code of Practice: Statement of Principles,” 2002.

United Nations Department of Economic and Social Affairs Statistics Division, “Generic Statistical Information Model (GSIM): Statistical Classifications Model,” 2015.

United Nations Economic Commission for Europe Secretariat, “Generic Statistical Business Process Model: GSBPM,” 2013.

“Modernisation Maturity Model (MMM) – Roadmap for Implementing Modernstats Standards – UNECE Statistics Wikis.” [Online]. Available: http://www1.unece.org/stat/platform/pages/viewpage.action?pageId=129172266. [Accessed: 28-Feb-2017].

Paulk, M. C., Curtis, B., Chrissis, M. B., and Weber, C. V. (1993). “Capability Maturity Model for Software, Version 1.1”.

Jugdev, K. and Thomas, J. (2002). “Project Management Maturity Models: The Silver Bullets of Competitive Advantage?,” Proj. Manag. J., 33(4), 4–14.

De Bruin, T., Freeze, R., Kaulkarni, U., and Rosemann, M. (2005). “Understanding the Main Phases of Developing a Maturity Assessment Model,” in Australasian Conference on Information Systems (ACIS), 8–19.

Simonin, T. (2009). “The Holistic Organization Model.” p. 4.

International Organization for Standardization, “ISO 9000:2015, Quality management systems — Fundamentals and vocabulary,” 2015.

United Nations Economic Commission for Europe (UNECE), “Quality Indicators for the Generic Statistical Business Process Model (GSBPM) – For Statistics derived from Surveys,” 2016.

Expert Group on National Quality Assurance Frameworks, “Guidelines for the Template for a Generic National Quality Assurance Framework (NQAF),” 2012.

Expert Group on National Quality Assurance Frameworks, “National Quality Assurance Framework Glossary,” 2012.

Pöppelbuß, J., and Röglinger, M. (2011). “What makes a useful maturity model? A framework of general design principles for maturity models and its demonstration in business process management,” Ecis, p. Paper28.

“Introduction to the Modernisation Maturity Model and its Roadmap – Roadmap for Implementing Modernstats Standards – UNECE Statistics Wikis.” [Online]. Available: http://www1.unece.org/stat/platform/display/RMIMS/Introduction+to+the+Modernisation+Maturity+Model+and+its+Roadmap. [Accessed: 28-Feb-2017].

Open Data Watch, “The Data Value Chain: Moving from Production to Impact,” 1–8, 2017.

“Sustainable Development Goals Beliefs and Principles Agora Portal.” [Online]. Available: https://www.agora-parl.org/resources/aoe/sustainable-development-goals-beliefs-and-principles. [Accessed: 05-Jun-2017].

Thinyane, M. (2017). “Investigating an Architectural Framework for Small Data Platforms,” in Proceedings of the 17th European Conference on Digital Government (ECDG 2017), Lisbon, Portugal, 220–227.

Best, M. (2015). “Small Data and Sustainable Development,” in International Conference on Communication/Culture and Sustainable Development Goals: Challenges for a new generation, 1–6.

Downloads

Published

2018-09-20

How to Cite

Marcovecchio, I. ., Thinyane, M. ., Estevez, E. ., & Fillottrani, P. . (2018). Capability Maturity Models as a Means to Standardize Sustainable Development Goals Indicators Data Production. Journal of ICT Standardization, 6(3), 217–244. https://doi.org/10.13052/jicts2245-800X.633

Issue

Section

Articles