Model-Driven Skills Assessment in Knowledge Management Systems

Authors

  • Antonio Balderas Department of Computer Science, University of Cadiz, Av. de la Universidad de Cá diz 10, 11519, Puerto Real, Spain
  • Juan Antonio Caballero-Hernández EVAL for Research Group, University of Cadiz, Av. República Árabe Saharaui s/n, 11519, Puerto Real, Spain
  • Juan Manuel Dodero Department of Computer Science, University of Cadiz, Av. de la Universidad de Cá diz 10, 11519, Puerto Real, Spain
  • Manuel Palomo-Duarte Department of Computer Science, University of Cadiz, Av. de la Universidad de Cá diz 10, 11519, Puerto Real, Spain
  • Iván Ruiz-Rube Department of Computer Science, University of Cadiz, Av. de la Universidad de Cá diz 10, 11519, Puerto Real, Spain

Keywords:

knowledge management system, generic skills assessment, organizational learning, Model-Driven engineering

Abstract

Organizations need employees who perform satisfactorily in generic skills, such as teamwork, leadership, problem solving or interpersonal abilities, among others. In organizational environments, employees perform work that is not always visible for supervisors and, thus, they can hardly assess their performance in generic skills. By using a knowledge management system, the users are able to leave a trace of their activity in the system’s records. This research aims to address a computer supported assessment of the user’s generic skills from the perspective of Model-Driven engineering. First, a systematic mapping study is carried out to understand the state of the art. Second, a proposal based on Model-Driven engineering is presented and is then validated through an organizational learning process model. Our results are promising and we are able to conduct a scalable assessment based on objective indicators of the employee’s planning, time management and problem solving skills.

Downloads

Download data is not yet available.

Author Biographies

Antonio Balderas, Department of Computer Science, University of Cadiz, Av. de la Universidad de Cá diz 10, 11519, Puerto Real, Spain

Antonio Balderas received his MSc in Computer Science and his PhD degree at the University of Cadiz. He also works at the University of Cádiz as a Lecturer of the Department of Computer Engineering and as a researcher at the Software Process Improvement and Formal Methods group (SPI&FM). His research is focused on the field of Technology-Enhanced Learning. His doctoral thesis has been awarded as the best doctoral thesis in the field of educational technologies in 2016 by both the eMadrid project and the Spanish Chapter of the IEEE Education Society. Previously, He worked as a project manager in different Spanish IT companies.

Juan Antonio Caballero-Hernández, EVAL for Research Group, University of Cadiz, Av. República Árabe Saharaui s/n, 11519, Puerto Real, Spain

Juan Antonio Caballero-Hernández is a graduated in Computer Science and a PhD candidate at the University of Cadiz. His main research interest is focused on learning experiences based on serious games and diverse applications of Process Mining. Outside the academic environment, he has been working in different positions of the IT sector, including web development, managing teams and international projects.

Juan Manuel Dodero, Department of Computer Science, University of Cadiz, Av. de la Universidad de Cá diz 10, 11519, Puerto Real, Spain

Juan Manuel Dodero is a Professor of Computer Systems & Languages at the University of Cádiz. He has worked before as a lecturer at the University Carlos III of Madrid, as well as an R&D consultant for Spanish ICT companies. He holds a Computer Science and Engineering PhD from the University Carlos III of Madrid. His main research interests are creative computing and technology-enhanced learning, with a focus on software technologies for computer-aided creation and assessment. He has participated and coordinated in various R&D projects in relation with these subjects.

Manuel Palomo-Duarte, Department of Computer Science, University of Cadiz, Av. de la Universidad de Cá diz 10, 11519, Puerto Real, Spain

Manuel Palomo-Duarte received the MSc degree in computer science from the University of Seville and the PhD degree from the University of Cádiz. He works in the Computer Science Department of the University of Cadiz as an Associate Professor. He is the author of three book chapters, 20 papers published in indexed journals and more than 30 contributions to international academic conferences. His main research interests are learning technologies, serious games and collaborative web. He was a board member in Wikimedia Spain from 2012 to 2016.

Iván Ruiz-Rube, Department of Computer Science, University of Cadiz, Av. de la Universidad de Cá diz 10, 11519, Puerto Real, Spain

Ivá n Ruiz-Rube is an assistant professor at the University of Cadiz, Spain. He received his Master degree in Software Engineering and Technology from the University of Seville and his PhD from the University of Cadiz. His fields of research are technology-enhanced learning and software process improvement. He has published several papers in these fields. Previously, he has worked as a software engineer for consulting companies such as Everis Spain S.L. and Sadiel S.A.

References

F. Achcaoucaou, L. Guitart-Tarrés, P. Miravitlles-Matamoros, A. Núñez-Carballosa, M. Bernardo, and A. Bikfalvi. Competence assessment in higher education: a dynamic approach. Human Factors and Ergonomics in Manufacturing & Service Industries, 24(4):454–467, 2014.

M. Luz Alvarez, I. Sarachaga, A. Burgos, E. Estévez, and M. Marcos. A methodological approach to model-driven design and development of automation systems. IEEE Transactions on Automation Science and Engineering, 15(1):67–79, 2018.

M. André, M. G Baldoqúin, and S. T. Acuña. Formal model for assigning human resources to teams in software projects. Information and Software Technology, 53(3):259–275, 2011.

L. Argote. Organization learning: a theoretical framework. In Organizational learning, pages 31–56. Springer, 2013.

E. Arno-Macia and C. Rueda-Ramos. Promoting reflection on science, technology, and society among engineering students through an eap online learning environment. Journal of English for Academic Purposes, 10(1):19–31, 2011.

A.A.Aziz,A. Mohamed, N.Arshad, S. Zakaria, and M. S. Masodi. Appraisal of course learning outcomes using rasch measurement: a case study in information technology education. International Journal of Systems Applications, Engineering & Development, 4(1):164–172, 2007.

L. Bailyn. Toward the perfect work place? the experience of home-based systems developers. In Information Technology and the Corporation of The 1990s : Research Studies, pages 410–439. Oxford University Press, 1994.

A. Balderas, J. A. Caballero-Hernández, J. M. Dodero, M. Palomo-Duarte, and I. Ruiz-Rube. Assessment of generic skills through an organizational learning process model. In Proceedings of the 14th International Conference on Web Information Systems and Technologies – Volume 1: WEBIST, pages 293–300. INSTICC, SciTePress, 2018.

A. Balderas, J. M. Dodero, M. Palomo-Duarte, and I. Ruiz-Rube. A domain specific language for online learning competence assessments. International Journal of Engineering Education, 31(3):851–862, 2015.

M. Bedek, S. A. Petersen, and T. Heikura. From behavioral indicators to contextualized competence assessment. In 11th IEEE International Conference on Advanced Learning Technologies (ICALT), 2011, pages 277–281. IEEE, 2011.

J. V. Benlloch-Dualde and S. Blanc-Clavero. Adapting teaching and assessment strategies to enhance competence-based learning in the framework of the european convergence process. In 37th Annual Frontiers In Education Conference-Global Engineering: Knowledge Without Borders, Opportunities Without Passports, 2007. FIE’07., pages S3B–1. IEEE, 2007.

P. C. Candy and R. G. Crebert. Ivory tower to concrete jungle: the difficult transition from the academy to the workplace as learning environments. The Journal of Higher Education, 62(5):570–592, 1991.

A. Carreras-Marín, Y. Blasco, M. Badia-Miró, M. Bosch-Príncep, I. Morillo, G. Cairó-i Céspedes, and D. Casares-Vidal. The promotion and assessment of generic skills from interdisciplinary teaching teams. EDULEARN13 Proceedings, pages 201–207, 2013.

Y. Chang, T. Eklund, J. I Kantola, and H. Vanharanta. International creative tension study of university students in south korea and finland. Human Factors and Ergonomics in Manufacturing & Service Industries, 19(6):528–543, 2009.

A. R. Da Silva. Model-driven engineering: a survey supported by the unified conceptual model. Computer Languages, Systems & Structures, 43:139–155, 2015.

D. Djaouti, J. Alvarez, and J. P. Jessel. Classifying serious games: the g/p/s model. Handbook of research on improving learning and motivation through educational games: Multidisciplinary approaches, pages 118–136, 2011.

J. G. Enríquez, J. M. Sánchez-Begines, F. J. Domínguez-Mayo, J. A. García-García, and M. J. Escalona. An approach to characterize and evaluate the quality of product lifecycle management software systems. Computer Standards & Interfaces, 61:77 – 88, 2019.

P. Ficapal-Cusí and J. Boada-Grau. e-learning and team-based learning: practical experience in virtual teams. Procedia-Social and Behavioral Sciences, 196:69–74, 2015.

A. Fidalgo-Blanco, D. Lerís, M. L. Sein-Echaluce, and F. J. García-Peñalvo. Monitoring indicators for ctmtc: comprehensive training model of the teamwork competence in engineering domain. International Journal of Engineering Education, 31(3):829–838, 2015.

A. Fidalgo-Blanco, M. L. Sein-Echaluce, F. J. García-Peñalvo, and M. A. Conde. Using learning analytics to improve teamwork assessment. Computers in Human Behavior, 47(C):149–156, June 2015.

Gescompeval. https://assembla.com/spaces/inteweb-gescompe val, 2014.

M. Guenaga, S. Arranz, I. Rubio-Florido, E. Aguilar, A. Ortizde Guinea, A. Rayon, M. J. Bezanilla, and I. Menchaca. Serious games for the development of employment oriented competences. IEEE Revista Iberoamericana de Tecnologías del Aprendizaje, 8(4):176–183, 2013.

P. Huang and Y. Guo. Research on the relationships among knowledge transfer, organizational learning and dynamic competence. Ninth Wuhan International Conference On E-Business, I-III:1449–1456, 2010.

Tuning Educational Structures in Europe Project. Generic competences. http://unideusto.org/tuningeu/competences/generic.html, 2003. Accessed: 2019-03-05.

B. Kitchenham, R. Pretorius, D. Budgen, O. P. Brereton, M. Turner, M. Niazi, and S. Linkman. Systematic literature reviews in software engineering–a tertiary study. Information and Software Technology, 52(8):792–805, 2010.

R. Lacuesta, G. Palacios, and L. Fernández. Active learning through problem based learning methodology in engineering edu-cation. In 39th IEEE Frontiers in Education Conference, 2009. FIE’09., pages 1–6. IEEE, 2009.

A. Lasa, I. Txurruka, E. Simón, and J. Miranda. Problem based learning implementation in the degree of human nutrition and dietetics. Proceedings of the International Conference of Education, Research and Innovation (ICERI), pages 1687–1692, 2013.

J. Liebowitz and M. Frank. Knowledge Management and e-Learning. CRC press, 2016.

M. R. Martín-Briceño and S. Prashar. Acquired skills with the implementation of new evaluation methods at University Rey Juan Carlos. Proceedings of the International Conference of Education, Research and Innovation (ICERI), pages 4875–4878, 2013.

A. Masip-Álvarez, C. Hervada-Sala, T. Pa`mies-Gómez, A. Arias-Pujol, C. Jaen-Fernandez, C. Rodriguez-Sorigue, D. Romero-Duran, F. Nejjari-Akhi-Elarab, M. Alvarez-del Castillo, M. Roca-Lefler, et al. Self-video recording for the integration and assessment of generic competencies. In IEEE Global Engineering Education Conference (EDUCON), pages 436–441. IEEE, 2013.

A. M. Nita, I. G. Solomon, and L. Mihoreanu. Building competencies and skills for leadership through the education system. In The International Scientific Conference eLearning and Software for Education, volume 2, page 410. “Carol I” National Defence University, 2016.

B. Oliver. Graduate attributes as a focus for institution-wide curriculum renewal: innovations and challenges. Higher Education Research & Development, 32(3):450–463, 2013.

J. E. Perez-Martinez, J. García-Martín, and A. Sierra-Alonso. Teamwork competence and academic motivation in computer science engineering studies. In IEEE Global Engineering Education Conference (EDUCON), pages 778–783. IEEE, 2014.

K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson. Systematic mapping studies in software engineering. In EASE, volume 8, pages 68–77, 2008.

N. Piedra, J. Chicaiza, J. López, A. Romero, and E. Tovar. Measuring collaboration and creativity skills through rubrics: experience from UTPL collaborative social networks course. In IEEE Education Engineering (EDUCON), pages 1511–1516. IEEE, 2010.

R. A. Rashid, R. Abdullah, A. Zaharim, H. Ahmad Ghulman, M. S. Masodi, J. L. Mauri, A. Zaharim, A. Kolyshkin, M. Hatziprokopiou, A. Lazakidou, et al. Engineering students performance evaluation of generic skills measurement: ESPEGS model. In Proceedings of the 5th WSEAS International Conference on Engineering Education (EE’08), volume 5, pages 377–383. World Scientific and Engineering Academy and Society (WSEAS), 2008.

A. Rayon-Jerez, M. Guenaga, and A. Núñez. A web platform for the assessment of competences in mobile learning contexts. In IEEE Global Engineering Education Conference (EDUCON), pages 321–329. IEEE, 2014.

M. L. Renau-Renau and J. Usó-Viciedo. Teaching and learning through projects using the ict: practice of the english writing through business documents. Proceedings of the International Conference of Education, Research and Innovation (ICERI) 2010, pages 4700–4705, 2010.

S. Rodriguez-Donaire, B. Amante-García, and S. Oliver-Del-Olmo. e-portfolio: a tool to assess university students’ skills. In 9th International Conference on Information Technology Based Higher Education and Training, pages 114–124. IEEE, 2010.

C. Ruizacárate-Varela, M. J. García-García, C. González-Garía, and J. L. Casado-SÁnchez. Soft skills: a comparative analysis between online and classroom teaching. In Proceedings of the International Conference on Advanced Education Technology and Management Science (AETMS2013), pages 359–366. DEStech Publications, 2013.

M. S. Sáiz-Ibarra, D. Cabeza-Sánchez, A. R. León-Rodríguez, G. Rodríguez-Gómez, M. A. Gómez-Ruiz, B. Gallego-Noche, V. Quesada-Serra, J. Cubero-Ibáñez, et al. Evalcomix en moodle: Un medio para favorecer la participación de los estudiantes en la e-evaluación. RED, Revista de Educación a Distancia. Special number-SPDECE, 2010.

J. Serrano-Guerrero, F. P. Romero, and J. A. Olivas. Hiperion: a fuzzy approach for recommending educational activities based on the acquisition of competences. Information Sciences, 248: 114–129, 2013.

A. Sevilla-Pavón, A. Martínez-Sáez, and A. Gimeno-Sanz. Assessment of competences in designing online preparatory materials for the cambridge first certificate in english examination. Procedia-Social and Behavioral Sciences, 34:207–211, 2012.

A. I. Starcic. Sustaining teacher’s professional development and training through web-based communities of practice. In International Symposium on Applications and the Internet, 2008. SAINT 2008., pages 317–320. IEEE, 2008.

J. Strijbos, N. Engels, and K. Struyven. Criteria and standards of generic competences at bachelor degree level: a review study. Educational Research Review, 14:18–32, 2015.

P. Tynjälä. Perspectives into learning at the workplace. Educational research review, 3(2):130–154, 2008.

C. Vizcarro-Guarch, P. Martin-Espinosa, R. Cobos, J. E. Pérez, E. Tovar-Caro, G. Blanco-Viejo, A. Bermudez-Marin, and J. R. Ruiz-Gallardo. Assessment of problem solving in computing studies. In IEEE Frontiers in Education Conference, 2013, pages 999–1003. IEEE, 2013.

T. Ward and S. Christophe. Developing entrepreneurial accounting and finance competency using the elleiec virtual centre for enterprise. In Proceedings of the 22nd European Association For Education In Electrical And Information Engineering Annual Conference (EAEEIE), pages 1–5. IEEE, 2011.

R. Wieringa, N. Maiden, N. Mead, and C. Rolland. Requirements engineering paper classification and evaluation criteria: a proposal and a discussion. Requirements Engineering, 11(1):102–107, 2006.

F. Yang, F. W. B. Li, and R. W. H. Lau. A fine-grained outcome-based learning path model. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 44(2):235–245, 2014.

Downloads

Issue

Section

Articles