Simulation-based Assessment In Higher Education: Adapting To The Era Of Artificial Intelligence
Keywords:
AI, assessment, simulation, teacher education, virtual exchangeAbstract
This qualitative study explores the integration of artificial intelligence (AI) in education, focusing on a simulation-based assessment methodology implemented in a Master's course in Valencia, Spain. The research addresses the growing challenges of AI in academic settings, including concerns about academic integrity, the limitations of traditional assessment methods, and the need for authentic evaluation of student competencies. By employing simulation and virtual exchange as pedagogical strategies, the study examines how pre-service teachers from nine universities engage in professional role-playing scenarios across four synchronous sessions. The research investigates the use of AI as a tool for brainstorming and organising information during these simulations. Through observations of dialogic interactions made by academic observers, the study aims to understand the potential of simulation-based learning in developing professional competencies, fostering authentic assessment, and navigating the ethical considerations surrounding AI use in education. This approach offers insights into alternative assessment methodologies that can effectively evaluate student authorship and knowledge while harnessing the advantages of AI in educational settings.
References
Adams, B., Thomas, L., Moens, M., & Valcke, M. (2023). University teachers as versatile masters: Evaluating the effectiveness of a professional development programme on student-centred teaching competencies. Studies in Educational Evaluation, 77, 101260.
Álvarez, M. N. (2023). Aprendizaje visible y consciente a través de "lesson study" y "debriefing" en la formación inicial docente (Doctoral dissertation). https://riucv.ucv.es/handle/20.500.12466/2833
Angelini, M. L. (2016). Integration of the pedagogical models “simulation” and“ flipped classroom” in teacher instruction. Sage Open, 6(1), 2158244016636430
Angelini, M. L., & García-Carbonell, A. (2019). Developing English Speaking Skills through Simulation-Based Instruction. Teaching English with Technology, 19(2), 3-20.
Angelini, M. L. (2021). Learning through simulations: Ideas for educational practitioners. Springer Nature.
Angelini, M. L., & Muñiz, R. (2021). Simulation through virtual exchange in teacher training. Edutec, Revista Electrónica de Tecnología Educativa, (75), 65-89.
Angelini, M. L., Diamanti, R., & Aguilar-Moya, R. (2024). Predictive Factors for Difficulty in Simulation Methodology in Teacher Education. Simulation&Gaming, (0). https://doi.org/10.1177/10468781241234812
De Coninck, K., Valcke, M., Ophalvens, I., & Vanderlinde, R. (2019). Bridging the theory-practice gap in teacher education: The design and construction of simulation-based learning environments. Kohärenz in der Lehrerbildung: Theorien, Modelle und empirische Befunde, 263-280.
Dieckmann, P. (2020). The unexpected and the non-fitting - considering the edges of simulation as social practice. Advances in simulation (London, England), 5, 2. doi:10.1186/s41077- 020-0120.
Fischetti, J., Ledger, S., Lynch, D., & Donnelly, D. (2022). -Practice before practicum: simulation in initial teacher education. The Teacher Educator, 57(2), 155-174.
Jiménez-Rodríguez, M. Á. ., Angelini, M. L., & Tasso, C. (2021). Orientaciones metodológicas para el desarrollo del pensamiento crítico. Ediciones Octaedro.
Kasperski, R., Levin, O., & Hemi, M. E. (2025). Systematic Literature Review of Simulation-Based Learning for Developing Teacher SEL. Education Sciences, 15(2), 129.
Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: systematic literature review. International Journal of Educational Technologyin Higher Education, 20(1), 56.
Ledger, S., Burgess, M., Rappa, N., Power, B., Wong, K. W., Teo, T., &Hilliard, B. (2022). Simulation platforms in initial teacher education: Past practice informing future potentiality. Computers & Education, 178, 104385.
Lehmann, T. (2022). Student teachers’ knowledge integration across conceptual borders: the role of study approaches, learning strategies, beliefs, and motivation. European Journal of Psychology of Education, 37(4), 1189-1216.
Levin, O., & Flavian, H. (2022). Simulation-based learning in the context of peer learning from the perspective of preservice teachers: A case study. European Journal of Teacher Education, 45(3), 373-394.
Levin, O., Frei-Landau, R., Flavian, H., & Miller, E. C. (2023). Creating authenticity in simulation-based learning scenarios in teacher education. European Journal of Teacher Education, 1-22.
Murata, A., & Siker, J. (2023). Shifting Perspectives in Simulation: Implications to Pedagogical Learning of Preservice Teachers. In Simulation for Participatory Education: Virtual Exchange and Worldwide Collaboration (pp. 323-335). Springer International Publishing.
Parsakia, K. (2023). The effect of chatbots and AI on the self-efficacy, self-esteem, problem-solving and critical thinking of students. Health Nexus, 1(1), 71-76.
Pop, R. (2023). The Role of Simulation and Virtual Exchange in the Context of EFL Pre-service Teacher Training in Romania. In Simulation for Participatory Education: Virtual Exchange and Worldwide Collaboration (pp. 395-404). Springer International Publishing.
Sandín M. (2003). Qualitative research in education. McGraw-Hill.
Selwyn, N. (2024). Digital degrowth: Toward radically sustainable education technology. Learning, Media and Technology, 49(2), 186-199.
Shirts, R. G. (1975). Notes on defining “Simulation”. Gaming-simulation: Rationale, design and applications. A text with parallel readings for social scientists, educators, and community workers. Wiley & Sons.
Siker, J. (2023). Simulation in Preparing Teachers to Work with Learners with Diverse Abilities. Simulation for Participatory Education: Virtual Exchange and Worldwide Collaboration, (337-345) Springer International Publishing.
Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., ... & Gašević, D. (2022). Assessment in the age of artificial intelligence. Computers and Education: Artificial Intelligence, 3, 100075.
Twining, P.; Heller, R.; Nussbaum, M. & Tsai, C. (2017). Some Guidance on Conducting and Reporting Qualitative Studies. Computers & Education, 106 A1-A9
Vallés, M. (1997). Qualitative techniques of social research. Methodological reflection and professional practice.
Síntesis S.A. Vallés, M. (2002). Qualitative interviews. Centro de Investigaciones Sociológicas.
Zawacki-Richter, O., Bai, J. Y., Lee, K., Slagter van Tryon, P. J., &Prinsloo, P. (2024). New advances in artificial intelligence applications in higher education?. International Journal of Educational Technology in Higher Education, 21(1), 32.