Investigating Role of Artificial Intelligence for Preparing Question Paper Till Evaluation Process in Open Book Examination System

Authors

  • Amit Dimari Humanities and Social Sciences, Graphic Era Deemed University Dehradun – 248001, India
  • Nidhi Tyagi Humanities and Social Sciences, Graphic Era Deemed University Dehradun – 248001, India
  • S. Srinivasan Humanities and Social Sciences, Graphic Era Deemed University Dehradun – 248001, India
  • Mahesh Davanageri Graphic Era (Deemed to be) University Dehradun – 248001, India
  • Prabha Lama Humanities and Social Sciences, Graphic Era Deemed University Dehradun – 248001, India
  • Hema Dimari Examination Cell, Graphic Era hill University Dehradun – 248001, India

DOI:

https://doi.org/10.13052/jrss0974-8024.1811

Keywords:

Artificial intelligence, open book examinations, question paper preparation, evaluation process, feasibility

Abstract

In the rapidly evolving landscape of higher education, the integration of AI in various assessment techniques presents before us a revolutionary potential for grading systems. This research study aimed to investigate the role of Artificial Intelligence (AI) in open-book examinations, with a focus on question paper preparation and evaluation processes. The research employed a Quantitative approach, including surveys and data analysis techniques. The sample size of 165 participants was taken as a sample in the study which includes students, educators and administrators from various academic institutions who have implemented open book examination systems. Participants were chosen on the basis of purposive sampling technique that have vast experience in AI technologies and open book system as well. The findings revealed significant differences and associations between AI integration and traditional methods in open-book examinations. Challenges identified in traditional methods included time constraints and subjectivity in evaluation. The t-test analysis showed significant differences in the feasibility and effectiveness of open-book examinations between AI-integrated and traditional methods. There was a significant association between traditional question paper preparation and evaluation methods and the identified challenges. Additionally, a significant difference was found in the benefits and advantages of using AI technologies in question paper preparation for open book exams. The authors arrived at the resolution that further examination and educator preparation are expected to completely get a handle on the capability of artificial intelligence in instructive assessment, especially schooling level lower than advanced education.

Downloads

Download data is not yet available.

Author Biographies

Amit Dimari, Humanities and Social Sciences, Graphic Era Deemed University Dehradun – 248001, India

Amit Dimari received his bachelor’s degree in commerce from Hemvati Nandan Bahuguna Garhwal University (HNBGU), He Completed his master degree in commerce, library science and Sociology, and now he is pursuing his Doctor of Philosophy degree in Sociology, form Graphic Era (Deemed to be University). He is currently working as a Section Officer in Examination Department at Graphic Era (Deemed to be University), Dehradun; he has published research papers and book chapters in esteemed journals indexed in UGC CARE-list, peer reviewed and Scopus.

Nidhi Tyagi, Humanities and Social Sciences, Graphic Era Deemed University Dehradun – 248001, India

Nidhi Tyagi is working as a Professor at Graphic Era (Deemed to be University), Dehradun. under the aegis of Department of Humanities & Social Sciences. She was the founder member of Law College of Teerthanker Mahaveer University, Moradabad and rendered her services to the esteemed organization for a period of 10 years. Dr. Nidhi has a vast teaching experience of 19 years and has represented the Department in BCI, UGC, NAAC inspections and various administrative and academic activities. Besides, she has been contributing to different domains of Sociology and Indian Society. She has devoted herself to scholastic research and published many outstanding papers in different academic journals. Furthermore, Dr. Nidhi has presented more than 22 papers at national and international conferences and has also Chaired Sessions in various International Conferences.

S. Srinivasan, Humanities and Social Sciences, Graphic Era Deemed University Dehradun – 248001, India

S. Srinivasan has recently joined the Department of Humanities and Social Sciences at Graphic Era (Deemed to be University) as an Assistant Professor. With a wealth of experience, Mr. Srinivasan has accumulated 10 years of extensive teaching and field-level expertise. Prior to his current role, he served in the Ministry of Health and Family Welfare, Government of India, and gained valuable experience. He also contributed as a Guest Faculty at the university level and served for nearly 2 years in the State Government Public Works Department as a Mobilization Training Specialist. In the past year, Mr. S. Srinivasan has enriched his experience by actively participating in a Tuberculosis project funded by GFATM and USAID, providing a platform for further exploration of his research, and practical field-based knowledge. His scholarly contributions include publishing 45 papers, with 18 more under peer review in various UGC-Care, SCOPUS, and peer-reviewed journals. Mr. S. Srinivasan has also actively participated in 10 different training programs, including an ICSSR research methodology course, a Workshop on Scientific Writing and Publication, Applications of SPSS in Social Science Research, and Training of Trainers in life skill education. Furthermore, he has presented papers at 4 state-level conferences, 10 national conferences, and 15 international conferences. He has also presented and participated in various online international conferences.

Mahesh Davanageri, Graphic Era (Deemed to be) University Dehradun – 248001, India

Mahesh Davanageri is a distinguished academician with 30 years of experience in education administration and examination management. He serves as the Controller of Examination at Graphic Era Deemed to be University, overseeing exam processes and specializes in developing university-level examination systems. key achievements include implementing digital valuation, online exams, and blockchain-based degree certificates. He is active member of ISTE and IAENG, with numerous research publications in international conferences and journals.

Prabha Lama, Humanities and Social Sciences, Graphic Era Deemed University Dehradun – 248001, India

Prabha Lama serves as an Associate Professor and the Head of the Department of Humanities and Social Sciences at Graphic Era (Deemed to be University), where she plays a pivotal role in shaping the academic landscape. Having earned a Doctorate degree in English Literature, Dr Prabha possesses a wealth of teaching experience across diverse faculties, with a particular focus on legal language, English literature, and English communication, specializing in British literature, Indian literature, Women’s writing, and Post-Colonial Literature. Dr Prabha’s contributions extend beyond teaching; she has published research papers and book chapters in esteemed journals indexed in UGC CARE-list, peer reviewed and Scopus, also actively serves as a reviewer for reputable publications.

Hema Dimari, Examination Cell, Graphic Era hill University Dehradun – 248001, India

Hema Dimari completed her bachelor’s degree in History and later completed a Master of Business Administration (MBA) with Human Resource Management. She is currently working as an Office Executive in the Examination Department at Graphic Era Hill University, Dehradun.

References

Cellan-Jones, R. (2014): Stephen Hawking warns artificial intelligence could end mankind. BBC news, 2(10), 2014. (Report).

Chapelle, C. A., and Chung, Y. R. (2010): The promise of NLP and speech processing technologies in language assessment. Language Testing, 27(3), pp. 301–315.

Chew, E., and Chua, X. N. (2020): Robotic Chinese language tutor: personalising progress assessment and feedback or taking over your job? On the Horizon, 28(3), pp. 113–124.

Dawson, P., Nicola-Richmond, K., and Partridge, H. (2024): Beyond open book versus closed book: a taxonomy of restrictions in online examinations. Assessment & Evaluation in Higher Education, 49(2), pp. 262–274.

Duan, Y., Edwards, J. S., and Dwivedi, Y. K. (2019): Artificial intelligence for decision making in the era of Big Data–evolution, challenges and research agenda. International journal of information management, 48, pp. 63–71.

Farhi, F., Jeljeli, R., Aburezeq, I., Dweikat, F. F., Al-shami, S. A., and Slamene, R. (2023): Analyzing the students’ views, concerns, and perceived ethics about chat GPT usage. Computers and Education: Artificial Intelligence, 5, 100180. pp. 1–8.

Gálvez, J., Conejo, R., and Guzmán, E. (2013): Statistical techniques to explore the quality of constraints in constraint-based modeling environments. International Journal of Artificial Intelligence in Education, 23, pp. 22–49.

Jani, K. H., Jones, K. A., Jones, G. W., Amiel, J., Barron, B., and Elhadad, N. (2020): Machine learning to extract communication and history-taking skills in OSCE transcripts. Medical Education, 54(12), pp. 1159–1170.

Jonassen, D., Davidson, M., Collins, M., Campbell, J., and Haag, B. B. (1995): Constructivism and computer-mediated communication in distance education. American journal of distance education, 9(2), pp. 7–26.

Liu, M., Wang, Y., Xu, W., and Liu, L. (2017): Automated scoring of Chinese engineering students’ English essays. International Journal of Distance Education Technologies (IJDET), 15(1), pp. 52–68.

Lodhi, P., Mishra, O., Jain, S., and Bajaj, V. (2018). StuA: An intelligent student assistant. IJIMAI, 5(2), pp. 17–25.

Luckin, R; Holmes, W; (2016): Intelligence Unleashed: An argument for AI in Education. UCL Knowledge Lab: London, UK. ISBN: 13-9780992424886. Report.

Mellit, A., and Kalogirou, S. A. (2008): Artificial intelligence techniques for photovoltaic applications: A review. Progress in energy and combustion science, 34(5), pp. 574–632.

Narciss, S., Sosnovsky, S., Schnaubert, L., Andrès, E., Eichelmann, A., Goguadze, G., and Melis, E. (2014). Exploring feedback and student characteristics relevant for personalizing feedback strategies. Computers & Education, 71, pp. 56–76.

Nilson, N. J., “John McCarthy, (2012): A Biographical Memoir,” National Academy of Sciences, 1–27. (Report).

Ocaa-Fernández, Valenzuela-Fernández, L. A., and Garro-Aburto, L. L. (2019): Artificial Intelligence and its Implications in Higher Education. Propós. represent. vol. 7, n. 2, pp. 536–568.

Perez, S., Massey-Allard, J., Butler, D., Ives, J., Bonn, D., Yee, N., and Roll, I. (2017): Identifying productive inquiry in virtual labs using sequence mining. In Artificial Intelligence in Education: 18th International Conference, AIED 2017, Wuhan, China, June 28–July 1, 2017, Proceedings 18, pp. 287–298.

Popenici, S. A., and Kerr, S. (2017): Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and practice in technology enhanced learning, 12(1), pp. 2–13.

Quille, K., Nolan, K., Becker, B. A., and McHugh, S. (2021): Developing an open-book online exam for final year students. In Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1 pp. 338–344.

Rawlinson, K (2015): Microsoft’s Bill Gates insists AI is a threat. BBC News. Report.

Richardson, M., and Clesham, R. (2021): Rise of the machines? The evolving role of Artificial Intelligence (AI) technologies in high stakes assessment. London Review of Education, 19(1), pp. 1–13.

Roberts, L., and Berry, J. (2023): Should open-book, open-web exams replace traditional closed-book exams in STEM? An evaluation of their effectiveness in different disciplines. Journal of Learning Development in Higher Education, (28). pp. 1–39.

Samarakou, M., Fylladitakis, E., Fruh, W. G., Karolidis, D., Hatziapostolou, A., Athinaios, S., and Grigoriadou, M. (2016): Evaluation of an intelligent open learning system for engineering education. Knowledge Management and E-Learning: An International Journal, 8(3), pp. 496–513.

Santos, O. C., and Boticario, J. G. (2014): Involving users to improve the collaborative logical framework. The Scientific World Journal, 2014(1), pp. 1–15.

Saplacan, D., Herstad, J., and Pajalic, Z. (2018): Feedback from digital systems used in higher education: An inquiry into triggered emotions-two universal design oriented solutions for a better user experience. In Transforming our World Through Design, Diversity and Education, pp. 421–430.

Suhaimy, K. A. M., Salleh, B. M., and Esa, A. (2012): The Open Book Examination. Journal of Techno-Social (JTS) Volume 4(2). ISSN: 2229-8940, pp. 1–12.

van den Berg, G., and du Plessis, E. (2023): ChatGPT and generative AI: Possibilities for its contribution to lesson planning, critical thinking and openness in teacher education. Education Sciences, 13(10), pp. 998.

Yuwei Li (2024): Procedia Computer Science, ‘The 4th International Conference on Machine Learning and Big Data Analytics for IoT Security and Privacy”, Vol. 243, pp. 1222–1230.

Downloads

Published

2025-02-27

How to Cite

Dimari, A. ., Tyagi, N. ., Srinivasan, S. ., Davanageri, M. ., Lama, P. ., & Dimari, H. . (2025). Investigating Role of Artificial Intelligence for Preparing Question Paper Till Evaluation Process in Open Book Examination System. Journal of Reliability and Statistical Studies, 18(01), 1–24. https://doi.org/10.13052/jrss0974-8024.1811

Issue

2025: Vol 18 Iss 1

Section

Articles