Design, Implementation, and Evaluation of Online Open-Book Exams: Insights from Medical Students’ Perspectives

نویسندگان

1 Department of Medical Education, Virtual School of Medical Education and Management, Shahid Beheshti University of Medical Sciences, Tehran, Iran

2 Department of E-Learning in Medical Sciences, Virtual School and Center of Excellence in e-Learning, Shiraz University of Medical Sciences, Shiraz, Iran

3 Department of LIME, Research Affiliated Faculty, Karolinska Institute, Solna, Sweden

4 Department of E-learning in Medical Sciences, Virtual School and Center of Excellence in E-learning, Shiraz University of Medical Sciences, Shiraz, Iran

doi
10.30476/ijvlms.2023.101003.1276
چکیده

Assessment of students is a crucial aspect of the educational process, closely tied to the quality of learning. Between April 2019 and August 2022, we designed, implemented, and evaluated online open-book examinations for 13 second-year doctoral students in medical education at Shahid Beheshti University of Medical Sciences (SBUMS), Iran, focusing on their perspectives. The exams were developed by a design team of six faculty members, who selected courses, created blueprints, question distributions, and realistic scenarios, and formulated questions based on open-book exam principles. Face and content validity were confirmed using feedback from 15 experts, with CVR ≥ 0.49 and CVI > 0.79, and reliability was verified via Cronbach’s alpha = 0.79. Exams were conducted online using Navaid Learning Management System (LMS), preceded by a pilot session to reduce student anxiety. Student satisfaction was assessed through a 10-item researcher-developed questionnaire on a 5-point Likert scale, validated by five medical education professors and tested for reliability (Cronbach’s alpha = 0.78). Additionally, a face-to-face critique session was conducted. Students generally provided positive feedback, reporting that the exams offered valuable and novel experiences, stimulated engagement, and allowed better handling of questions and scenarios. Some concerns were raised about technical issues, such as internet interruptions, power outages, or exam equipment malfunctions, which could potentially affect performance. Overall, the study shows that doctoral students were satisfied with the implementation of online open-book exams, highlighting the feasibility and acceptability of this approach in medical education.