SciELO - Scientific Electronic Library Online

 
vol.52 issue1Should videolaryngoscopy be routinely used for airway management? An approach from different scenarios in medical practiceThe value of mathematical modelling approaches in epidemiology for public health decisión making author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


Colombian Journal of Anestesiology

Print version ISSN 0120-3347On-line version ISSN 2256-2087

Rev. colomb. anestesiol. vol.52 no.1 Bogotá Jan./Mar. 2024  Epub Dec 22, 2023

https://doi.org/10.5554/22562087.e1085 

Special article

Artificial intelligence, applications and challenges in simulation-based education

Diego Andrés Díaz-Guioa  b 
http://orcid.org/0000-0003-4940-9870

Julián Henaob  c 
http://orcid.org/0009-0009-6610-3030

Andy Pantojab  d 
http://orcid.org/0009-0005-2447-8740

María Alejandra Arangob 

Ana Sofía Díaz-Gómezb 

Aida Camps Gómeze 
http://orcid.org/0000-0003-3310-1193

a Simulation and Innovation, Faculty of Medicine, Universidad San Sebastián. Santiago, Chile.

b Educational Innovation, VitalCare Clinical Simulation Center, Armenia, Colombia.

c School of Computer Engineering, Universidad del Valle. Cali, Colombia.

d School of Mechatronic Engineering, Universidad EAM. Armenia, Colombia.

e CISARC, Universidad de Manresa. Barcelona, Spain.


Abstract

The rapid advancement of Artificial Intelligence (AI) has taken the world by "surprise" due to the lack of regulation over this technological innovation which, while promising application opportunities in different fields of knowledge, including education, simultaneously generates concern, rejection and even fear.

In the field of Health Sciences Education, clinical simulation has transformed educational practice; however, its formal insertion is still heterogeneous, and we are now facing a new technological revolution where AI has the potential to transform the way we conceive its application.

Key words: Simulation-based education; ChatGPT; Artificial intelligence; Machine learning; Educational innovation

Resumen

El rápido avance de la inteligencia artificial (IA) ha tomado al mundo por "sorpresa" debido a la falta de regulación sobre esta innovación tecnológica, que si bien promete oportunidades de aplicación en diferentes campos del conocimiento, incluido el educativo, también genera preocupación e incluso miedo y rechazo.

En el campo de la Educación en Ciencias de la Salud la Simulación Clínica ha transformado la práctica educativa; sin embargo, aún es heterogénea su inserción formal, y ahora nos enfrentamos a una nueva revolución tecnológica, en la que las IA tienen el potencial de transformar la manera en que concebimos su aplicación.

Palabras clave: Educación basada en simulación; ChatGPT; Inteligencia artificial; Machine learning; Innovación educativa

INTRODUCTION

Clinical simulation has proven to be useful in multiple areas of health sciences education - undergraduate 1,2 and graduate training 3-5, and ongoing education 6,7-, making efficient practice possible in safe learning environments, with the help of technological techniques and components and supported by different perspectives of educational theory 8-10.

Technological breakthroughs undoubtedly drive the evolution of different fields of knowledge, with health sciences education and the specific field of Simulation-Based Education (SBE) being no exception, considering the important developments which are already a reality 11,12. Among the group of technologies applicable in education, artificial intelligence (AI) has gained momentum and been adopted at dizzying speed in recent years 13, ushering new possibilities for practical application; however, knowledge of its real application in clinical simulation training is still in its infancy.

This article explores some key concepts that will enable readers to understand the broad field of AI, its potential applications in the practice of simulation-based education, and the challenges which await those who teach health sciences, from the perspective of education science, computer engineering and mechatronic engineering.

What is artificial intelligence?

AI is a computer science study area focused on developing systems capable of performing tasks germane to human intelligence (learning, decision-making, natural language comprehension, problem solving, pattern recognition). AI study and research is not new. The term "artificial intelligence" was coined by John McCarthy in 1956 and, since that time, the field has been evolving continuously, fed by different approaches and interests, to become an academic discipline in its own right 14.

In the 196os, work revolved around automatic learning programs and neuronal network construction. Then, after research came to a standstill during the 70s and 8os, it gained strong momentum in the 90s with advances in computing and microprocessor development and research in various areas such as natural language programming, automatic learning, deep learning, and applications in robotics, autonomous driving, diagnostic medicine, and education, among many other fields 14,15.

AI is not actually "intelligence," at least not in the sense of human intelligence (HI); in practical terms, AI is rather a simulation of HI. It operates based on algorithms and complex mathematical models, providing machines with the ability to process huge amounts of data in short periods of time and make decisions with a low probability of error, using pattern recognition almost in real time 14.

A conceptual background is required in order to enhance our understanding of this relatively new field of AI application, considering that the new buzzwords like Chatbot, NLP, LLM, Machine Learning or Deep learning can be confusing.

Natural language processing (NLP)

NLP is one of the most important elements of all AI used as part of daily life. It focuses on enabling seamless and consistent text or voice communication between computers and human beings. NLP extracts information from an input, performs semantic, syntactic and context analysis and provides the user with a response that is similar to what a human being would provide, obviously with a margin of error. Currently, systems like Apple's SIRI, Amazon's Alexa, and customer service bots are used daily, while the more recent advanced NPL systems such as chatbots are also gaining popularity.

Worthy of mention among NLP models are Large Language Models (LLM), which contain billions of parameters. The parameters in these models are adjusted and optimized by means of large text datasets. This has given rise to skills such as contextual learning, following instructions and step-by-step reasoning, which were not present in older pre-trained language models (PLM) 16.

A chatbot, an interactive agent, digital assistant or artificial chat entity, is a computer program which understands one or more human languages, uses NLP and automated machine learning to interact with the user in response to inputs and context. It can be classified depending on the discrimination criterion, for example, by sophistication (basic-advanced, simple-complex), function (information, banking, etc.), interface (text, voice, mixed), target audience (children, older adults, students, etc.) 17,18.

One of the most important and best known chatbots today is ChatGPT from OpenAI. This AI-driven virtual assistant model is based on GPT (generative pre-trained transformer) which, in turn, is built on a neuronal network that trains using big data without the need for supervision, and is capable of generating highly accurate quality data in a matter of seconds in response to relatively simple inputs. Moreover, it can consider the context of previous input, making it very efficient and useful 19-21; however, it has given rise to much questioning in the academic and scientific world 16,22.

Machine learning

In the AI field, machine learning is a feature of the greatest importance with practical applications in health sciences, mainly in diagnostic imaging in medicine 23. Machine learning refers to the way in which computers learn through data and how they can use statistics and probabilities to enhance their performance 14,24.

Automated machine learning is usually classified into three types depending on the learning mode (supervised, unsupervised and reinforcement). In supervised learning, the machine uses previously labeled data to learn how to predict; in unsupervised learning, the model learns directly from the dataset where it finds patterns; and in reinforcement learning, the machine requires feedback regarding its actions 24,25.

Deep learning

The human brain has a huge network of interconnected neurons, and deep learning (a subfield of automated learning) seeks to replicate the human brain structure. In this form of automated learning, multiple layers of artificial neuronal networks that process and analyze a large amount of data are used. It has wide applications in practice, including natural language processing and image-based disease detection 23,26.

Role of AI in health sciences education (HSE)

AI in training

AI is revolutionizing the field of education in health sciences as it provides information within seconds, enhancing learning speed. In the past, health sciences students used books and encyclopedias; eventually, they moved to online sources using search engines and subscription databases. With generative AI connected to the net, students may obtain summarized, organized and coherent information using relatively simple inputs, without the need to review, compare or summarize the information they receive 22,27,28.

AI in evaluation

AI can be of help to teachers in the teaching-learning-evaluation process. It could identify learning patterns, the speed at which students analyze and how much information they retain and then create individual learning models that could be used to provide immediate, high-quality feedback to each student 21,29.

AI has many potential applications. However, concerns have emerged in the realm of education regarding open access to AI and its potential impact on the student's original creation in essays and other work 20,22. Although the most advanced AI can generate high quality text in natural language, the focus should be on how to reinvent the way to educate and how to update the existing educational structures considering that higher education institutions are closely tied to the concept of the I9th century university, with professors -most of them from the 20th century - and thinking models aligned with the logic of traditional education, while most of the students were born already in the 21st century, and are digital natives and consumers of disruptive technologies, as is the case of AI 30.

The role of AI in simulation-based education (SBE)

Development of simulators

There is growing interest in the application of technology to the development of simulators that can evoke a physiological response to the interventions from the participants, thus improving their experience through realism 31. A simulator with embedded AI capability could eventually provide real time response to the intervention (e.g., rhythm change in supraventricular tachycardia with after adenosine administration, without the need for an external operator in the control room).

Assistance with instructional design

Creating and drafting mock cases suited to the needs of the audience is usually time consuming 32; now, with specific instruction, the time required to write the cases is significantly shortened, personalizing the experience for the participants even more and allowing instructors additional time for other tasks.

Skill development analysis

Skill development requires the acquisition of groundwork concepts (declarative knowledge) and performance of the skill in practice (procedural knowledge), where deliberate practice leads to the achievement of good results 33-35. In skill development, dedicated AI could assess the performance of the participants, gather information and provide more accurate feedback (36), even allowing participants to use a chatbot to gain a better understanding of their own performance and obtain feedback (Figure 1).

Source: Authors.

Figure 1 Medical student using ChatGPT to get feedback of her performance in simulation.  

Assistance with debriefing

A central aspect of simulation-based education is guided conversation in the form of two-way feedback or deeper level debriefing 37. Although educational debriefing is desirable in zone 2 and zone 3 simulations 38, it is not always easy to do, in particular for novice instructors 39. AI has the power to analyze the discourse of the participants, find their mental models 40 and propose ways to improve, becoming an assistant to the debriefer.

Challenges to AI insertion in teaching practice

Although AI is already a reality within reach in health sciences education (HSE) - albeit less so in SBE - and it could bring about very interesting breakthroughs in the not-too-distant future, it is true that there are some financial, interaction and ethical limitations to its implementation in daily practice 20,27,29,41-43, as illustrated in Table 1.

Table 1 Limitations for incorporating AI in HSE and SBE. 

Challenges Description
Financial Implementation of new technologies entails costs. Regional economic inequalities are a limitation for the adoption of tools to embed AI into simulators and AI-driven applications in low and middle income countries, considering that the development of this technology requires substantial financial investments.
Data training AI will be powerful to the extent it is trained using large amounts of good quality data. HSE is heterogeneous and not standardized and, besides, there are data confidentiality policies, all of which can delay AI training.
Context comprehension Clinical contexts are everchanging, medical professions are diverse with varying training needs, and requiring very different settings. This could pose some challenges, at least in the short and medium term.
Human interaction Incorporation of technologies that learn as they are used can mean that people will become less necessary; however, the aim of SBE is to ensure patient safety, many times through teamwork, which requires human-human interaction.
Social biases Literature on AI in health has shown the potential for social biases given the programming received. These same biases can show up in SBE and have a negative impact on learning and/or evaluation.
Ethical AI incorporation in simulators or in specific chatbots can give rise to ethical issues related to student privacy violations.

Source: Authors.

CONCLUSIONS

SBE brought about a revolution in the way health sciences are taught and learned; now, with AI, a new revolution has arrived, bringing with it the potential to change the way in which we teach and learn.

AI is a reality, and it has many practical applications in education. Teachers must learn to use it as part of their daily practice within the teaching-learning process. From the authors' perspective, AI is more an assistant or copilot than an actual threat.

Over the next few months, AI will probably be incorporated into clinical simulation technologies, allowing for more personalized experiences tailored to the progress of individual students. However, there are countless challenges and limitations that must be addressed and studied in depth if the right policies and regulations are to be implemented.

REFERENCES

1. Cifuentes-Gaitán MJ, González-Rojas D, Ricardo-Zapata A, Díaz-Guio DA. Transfer of emergency and critical care learning from high fidelity simulation to clinical practice. Acta Colomb Cuid Intensivo. 2020;21(1):17-21. doi: https://doi.org/10.1016/j.acci.2020.06.001Links ]

2. Cortegiani A, Russotto V, Montalto F, Iozzo P, Palmeri C, Raineri SM, et al. Effect of high-fidelity simulation on medical students' knowledge about advanced life support: A randomized study. PLoS One. 2015;10(5):e0125685. doi: https://doi.org/10.1371/journal.pone.0125685Links ]

3. Arora S, Hull L, Fitzpatrick M, Sevdalis N, Birnbach DJ. Crisis management on surgical wards. Ann Surg. 2015;261(5):1. doi: https://doi.org/10.1097/SLA.0000000000000824Links ]

4. Doumouras AG, Engels PT. Early crisis non-technical skill teaching in residency leads to long-term skill retention and improved performance during crises: A prospective, non-randomized controlled study. Surg (United States). 2017;162(1):174-81. doi: https://doi.org/10.1016/j.surg.2016.11.022Links ]

5. Brydges R, Hatala R, Mylopoulos M. Examining residents' strategic mindfulness during self-regulated learning of a simulated procedural skill. J Grad Med Educ. 2016;8(3):364-71. doi: https://doi.org/10.4300/JGME-D-15-00491.1Links ]

6. Russell E, Petrosoniak A, Caners K, Mastoras G, Szulewski A, Dakin C, et al. Simulation in the continuing professional development of academic emergency physicians. Simul Heal. 2020;00(00):1-8. [ Links ]

7. Forristal C, Russell E, McColl T, Petrosoniak A, Thoma B, Caners K, et al. Simulation in the continuing professional development of academic emergency physicians. Simul Healthc J Soc Simul Healthc. 2020;Publish Ah(00):1-8. doi: https://doi.org/10.1017/cem.2019.87Links ]

8. Nestel D, Bearman M. Theory and simulation-based education: Definitions, world-views and applications. Clin Simul Nurs. 2015;11(8):349-54. doi: http://dx.doi.org/10.1016/j.ecns.2015.05.013Links ]

9. Ferrero F, Díaz-Guio DA. Simulation-based education: debating theoretical bases of teacher education. Simulación Clínica. 2021;3(1):35-9. doi: https://doi.org/10.35366/99867Links ]

10. Ferguson J, Astbury J, Willis S, Silverthorne J, Schafheutle E. Implementing, embedding and sustaining simulation-based education: What helps, what hinders. Med Educ. 2020;54(10):915-24. doi: https://doi.org/10.1111/medu.14182Links ]

11. Díaz-Guio DA, Ríos-Barrientos E, Santillán-Roldan PA, Díaz-Gómez AS, Ricardo-Zapata A, Mora-Martinez S, et al. Online-synchronized clinical simulation: an efficient teaching-learning option for the COVID-19 pandemic time and beyond. Adv Simul. 2021;6:30. doi: https://doi.org/10.21203/rs.3.rs-106185/v1Links ]

12. Sherwood RJ, Francis G. The effect of mannequin fidelity on the achievement of learning outcomes for nursing, midwifery and allied healthcare practitioners: Systematic review and meta-analysis. Nurse Educ Today. 2018;69:81-94. doi: https://doi.org/10.1016/j.nedt.2018.06.025Links ]

13. Ouyang F, Jiao P. Artificial intelligence in education: The three paradigms. Comput Educ Artif Intell. 2021;2(April):100020. doi: https://doi.org/10.1016/j.caeai.2021.100020Links ]

14. Haenlein M, Kaplan A. A brief history of artificial intelligence: On the past, present, and future of artificial intelligence. Calif Manage Rev. 2019;61(4):5-14. doi: https://doi.org/10.1177/0008125619864925Links ]

15. Moor M, Banerjee O, Abad ZSH, Krumholz HM, Leskovec J, Topol EJ, et al. Foundation models for generalist medical artificial intelligence. Nature. 2023;616(7956):259-65. doi: http://www.ncbi.nlm.nih.gov/pub-med/37045921Links ]

16. Dwivedi YK, Kshetri N, Hughes L, Slade EL, Jeyaraj A, Kar AK, et al. "So what if ChatGPT wrote it?" Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. Int J Inf Manage. 2023;71(March). doi: https://doi.org/10.1016/j.ijinfomgt.2023.102642Links ]

17. Khanna A, Pandey B, Vashishta K, Kalia K, Pradeepkumar B, Das T. A Study of Today's A.I. through chatbots and rediscovery of machine intelligence. Int J Service, Sci Technol. 2015;8(7):277-84. doi: https://doi.org/10.14257/ijunesst.2015.8.7.28Links ]

18. Adamopoulou E, Moussiades L. An overview of chatbot technology [Internet]. Vol. 584 IFIP IFIP Advances in Information and Communication Technology. Springer International Publishing; 2020. Pp. 373-83. Available at: http://dx.doi.org/10.1007/978-3-030-49186-4_31Links ]

19. Alser M, Waisberg E. Concerns with the usage of ChatGPT in Academia and Medicine: A viewpoint. Am J Med Open. 2023;100036. doi: https://doi.org/10.1016/j.ajmo.2023.100036Links ]

20. Halaweh M. ChatGPT in education: Strategies for responsible implementation. Contemp Educ Technol. 2023;15(2):ep421. doi: https://doi.org/10.30935/cedtech/13036Links ]

21. Moldt JA, Festl-Wietek T, Madany Mamlouk A, Nieselt K, Fuhl W, Herrmann-Werner A. Chatbots for future docs: exploring medical students' attitudes and knowledge towards artificial intelligence and medical chatbots. Med Educ Online. 2023;28(1). doi: https://doi.org/10.1080/10872981.2023.2182659Links ]

22. Lim WM, Gunasekara A, Pallant JL, Pallant JI, Pechenkina E. Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators. Int J Manag Educ. 2023;21(2):1-13. doi: https://doi.org/10.1016/j.ijme.2023.100790Links ]

23. Wang J, Zhu H, Wang SH, Zhang YD. A Review of deep learning on medical image analysis. Mob Networks Appl. 2021;26(1):351-80. doi: https://doi.org/10.1007/s11036-020-01672-7Links ]

24. Jayatilake SMDAC, Ganegoda GU. Involvement of machine learning tools in healthcare decision making. J Healthc Eng. 2021;2021. doi: https://doi.org/10.1155/2021/6679512Links ]

25. Time SR, Matching SS. Encyclopedia of the sciences of learning. Encyclopedia of the Sciences of Learning. 2012. [ Links ]

26. Young T, Hazarika D, Poria S, Cambria E. Recent trends in deep learning based natural language processing [Review Article]. IEEE Comput Intell Mag. 2018;13(3):55-75. doi: https://doi.org/10.1109/MCI.2018.2840738Links ]

27. Lee J, Wu AS, Li D, Kulasegaram KM. Artificial intelligence in undergraduate medical education: A scoping review. Acad Med. 2021;96(11):S62-70. doi: https://doi.org/10.1097/ACM.0000000000004291Links ]

28. Civaner MM, Uncu Y, Bulut F, Chalil EG, Tatli A. Artificial intelligence in medical education: a cross-sectional needs assessment. BMC Med Educ . 2022;22(1):1-9. doi: https://doi.org/10.1186/s12909-022-03852-3Links ]

29. Ossa LA, Rost M, Lorenzini G, Shaw DM, Elger BS. A smarter perspective: Learning with and from AI-cases. Artif Intell Med. 2023;135(October 2021):102458. doi: https://doi.org/10.1016/j.artmed.2022.102458Links ]

30. Monereo C, Pozo J. En qué siglo vive la escuela? Cuad Pedagog. 2001;298(January 2001):50-5. [ Links ]

31. Dieckmann P, Gaba D, Rall M. Deepening the theoretical foundations of patient simulation as social practice. Simul Healthc. 2007;2(3):183-93. doi: https://doi.org/10.1097/SIH.0b013e3180f637f5Links ]

32. Mcgriff SJ. Instructional System Design (ISD): Using the ADDIE Model. Instr Syst Coll Educ Penn State Univ [Internet]. 2000;2. Available at: https://www.lib.purdue.edu/sites/default/files/directory/butler38/ADDIE.pdfLinks ]

33. Díaz-Guio DA, del Moral I, Maestre JM. Do we want intensivists to be competent or excellent? Clinical simulation-based mastery learning. Acta Colomb Cuid Intensivo . 2015;15(3):187-95. doi: https://doi.org/10.1016/j.acci.2015.05.001Links ]

34. Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(10 Suppl):S70-81. doi: https://doi.org/10.1097/00001888-200410001-00022Links ]

35. Barsuk JH, Cohen ER, Wayne DB, Siddal VJ, McGaghie W. Developing a simulation-based mastery learning curriculum: Lessons from 11 years of advanced cardiac life support. Simul Heal . 2016;11(1):52-9. doi: https://doi.org/10.1097/SIH.0000000000000120Links ]

36. Ledwos N, Mirchi N, Yilmaz R, Winkler-schwartz A, Sawni A, Fazlollahi AM, et al. Assessment of learning curves on a simulated neurosurgical task using metrics selected by artificial intelligence. J Neurosurg. 2022;137:1160-71. doi: https://doi.org/10.3171/2021.12.JNS211563Links ]

37. Sawyer T, Eppich W, Brett-Fleegler M, Grant V, Cheng A. More than one way to debrief. Simul Healthc. 2016;11(3):209-17. doi: https://doi.org/10.1097/SIH.0000000000000148Links ]

38. Roussin C, Sawyer T, Weinstock P. Assessing competency using simulation: The SimZones approach. BMJ Simul Technol Enhanc Learn. 2020;6(5):262-7. doi: https://doi.org/10.1136/ bmjstel-2019-000480Links ]

39. Díaz-Guio D, Cimadevilla-Calvo B. Simulation-based education: debriefing, its fundamentals, benefits and difficulties. Revista Latinoamericana deSimulación Clínica . 2019;1:95-103. doi: https://doi.org/10.35366/ RSC192FLinks ]

40. Díaz-Guio DA, Ruiz-Ortega FJ. Relationship among mental models , theories of change , and metacognition: structured clinical simulation. Colombian Journal of Anesthesiology. 2019;47(14):113-6. doi: http://dx.doi.org/10.1097/CJ9.0000000000000107Links ]

41. Fengchun M, Wayne H, Huang R, Zhang H. AI and education Guidance for policymakers [Internet]. 2021. Avaiable at: https://unesdoc.unesco.org/ark:/48223/pf0000376709Links ]

42. Charow R, Jeyakumar T, Younus S, Dolataba-di E, Salhia M, Al-Mouaswas D, et al. Artificial intelligence education programs for health care professionals: Scoping review. JMIR Med Educ . 2021;7(4):1-22. doi: https://doi.org/10.2196/31043Links ]

43. OPS. Inteligencia artificial, 8 Principios rectores de la transformación digital del sector salud Caja de herramientas de transformación digital [Internet]. Inteligencia artificial. 2023. Available at: https://iris.paho.org/bitstream/handle/10665.2/57128/OPSEIHIS230003spa.pdf?sequence=1&isAllowed=yLinks ]

Funding The authors declare not having received funding for the preparation of this article.

How to cite this article: Díaz-Guio DA, Henao J, Pantoja A, Arango MA, Díaz-Gómez AS, Camps Gómez A. Artificial intelligence, applications and challenges in simulation-based education. Colombian Journal of Anesthesiology. 2024;52:e1085.

Received: June 03, 2023; Accepted: August 14, 2023; Published: September 01, 2023

Correspondence: Universidad San Sebastián, sede los Leones, Lota 2465. Santiago, Chile. Email: andres.diaz@vitalcare.co

Conflicts of interest

The authors declare having no conflict of interest to disclose.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License