A Framework for Disaster Exercise Evaluators’ Network Based on Critical Systems Approach

نویسندگان

1 Department of Industrial Engineering, University of Eyvanekey, Eyvanekey, Iran

2 Health Management Research Center, Life Style Institute, Baqiyatallah University of Medical Sciences, Tehran, Iran

3 Faculty of Health, Baqiyatallah University of Medical Sciences, Tehran, Iran

4 School of Health Management and Information, Iran University of Medical Sciences, Tehran, Iran

5 Tehran Disaster Mitigation and Management Organization, Tehran, Iran

doi
10.22034/ircmj.2025.500644.1810
چکیده

Background and Objectives: Effective evaluation is a critical component of disaster preparedness exercises, yet there is a notable lack of structured frameworks to support evaluators in complex scenarios. This study aims to design a structured framework based on critical systems methodologies to conduct the activities of the disaster exercise evaluators.   Methods: An embedded mixed method study was carried out in three phases: first, identifying evaluator activities using document review and interviews with 12 experts selected through purposive sampling and using qualitative content analysis; second, developing the framework using Team Syntegrity and Social Network Analysis; and third, validating it by an operational exercise in Tehran using quantitative exercise evaluation results from a purposive selection of 30 evaluators and analysis using Ucinet & NetDraw software.   Results: Evaluator activities were initially grouped into six groups. These activities were further refined and 30 key activities integrated into a structured framework consisting of four core phases aligned with the disaster exercise timeline: 1) concept and planning, 2) exercise conduct, 3) exercise evaluation, and 4) post-exercise evaluation. The application of the framework during an emergency accommodation exercise held in Tehran revealed valuable insights for planners in 12 areas of learning based on the findings of the quantitative and qualitative analysis presented.   Conclusion: The proposed framework demonstrates the potential to enhance communication, role clarity, and learning outcomes across all phases of the exercise cycle. Future efforts should focus on adapting evaluation methods to account for exercise complexity and integrating systems thinking to enhance learning and preparedness capabilities.