Surgical training in the era of artificial intelligence and large language models: a narrative review from the perspective of a surgical resident
DOI:
https://doi.org/10.18203/2349-2902.isj20263881Keywords:
Artificial intelligence, ChatGPT, Deskilling, Large language models, Residency training, Surgical educationAbstract
Artificial intelligence (AI) and large language models (LLMs) have entered surgical residency faster than the curricula, assessment systems and governance frameworks designed to accommodate them, yet most published appraisals adopt the standpoint of educators rather than that of the trainee, who is simultaneously the principal user and the principal subject of these tools. This narrative review, informed by the SANRA criteria, searched five databases from January 2015 to June 2026 and synthesises the evidence from the resident's perspective. Genuine educational value is supported in four domains: on-demand knowledge synthesis and examination preparation, intelligent tutoring and automated feedback in simulation, objective video- and kinematics-based skill assessment, and relief from administrative burden. Randomised trials show that AI tutoring improves machine-derived performance metrics but that gains are often not reproduced on blinded human ratings, and that AI combined with expert instruction outperforms AI alone. Against this stand substantial risks: hallucination and guideline drift, with accuracy falling sharply on current, guideline-specific content; the first real-world signal of clinical deskilling following routine AI exposure in a procedural specialty; cognitive offloading, with attendant mis-skilling and never-skilling during formative training; threats to assessment construct validity and to the apprenticeship relationship; breaches of confidentiality; algorithmic bias; and a widening divide between well-resourced and resource-constrained programmes. Surveys show substantial trainee uptake alongside negligible formal instruction. The governing principle for the trainee is sequence: independent reasoning and unassisted practice must precede augmentation. Training programmes should teach structured AI literacy, protect AI-free deliberate practice, and adopt verification-centred supervision.
References
George BC, Bohnen JD, Williams RG, Meyerson SL, Schuller MC, Clark MJ, et al. Readiness of US general surgery residents for independent practice. Ann Surg. 2017;266(4):582-94.
Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84(2):273-8.
Rubalcava NS, Guetter CR, Kapani N, Quiñones PM. How artificial intelligence is expected to transform surgical training. Bull Am Coll Surg. 2023;108(8).
Kirubarajan A, Young D, Khan S, Crasto N, Sobel M, Sussman D. Artificial intelligence and surgical education: a systematic scoping review of interventions. J Surg Educ. 2022;79(2):500-15.
Baethge C, Goldbeck-Wood S, Mertens S. SANRA—a scale for the quality assessment of narrative review articles. Res Integr Peer Rev. 2019;4:5.
Pedrett R, Mascagni P, Beldi G, Padoy N, Lavanchy JL. Technical skill assessment in minimally invasive surgery using artificial intelligence: a systematic review. Surg Endosc. 2023;37(10):7412-24.
Kim JWB, Chen JT, Hansen P, Shi LX, Goldenberg A, Schmidgall S, et al. SRT-H: a hierarchical framework for autonomous surgery via language-conditioned imitation learning. Sci Robot. 2025;10(104):eadt5254.
Yudovich MS, Makarova E, Hague CM, Raman JD. Performance of GPT-3.5 and GPT-4 on standardized urology knowledge assessment items in the United States: a descriptive study. J Educ Eval Health Prof. 2024;21:17.
Tsai CY, Hsieh SJ, Huang HH, Deng JH, Huang YY, Cheng PY. Performance of ChatGPT on the Taiwan urology board examination: insights into current strengths and shortcomings. World J Urol. 2024;42(1):250.
Kollitsch L, Eredics K, Marszalek M, Rauchenwald M, Brookman-May SD, Burger M, et al. How does artificial intelligence master urological board examinations? A comparative analysis of different large language models' accuracy and reliability in the 2022 in-service assessment of the European Board of Urology. World J Urol. 2024;42(1):20.
Talyshinskii A, Juliebø-Jones P, Hameed BMZ, Naik N, Adhikari K, Zhanbyrbekuly U, et al. ChatGPT as a clinical decision maker for urolithiasis: compliance with the current European Association of Urology guidelines. Eur Urol Open Sci. 2024;69:51-62.
Khalpey Z, Kumar U, King N, Abraham A, Khalpey AH. Large language models take on cardiothoracic surgery: a comparative analysis of the performance of four models on American Board of Thoracic Surgery exam questions in 2023. Cureus. 2024;16(7):e65083.
Hetz MJ, Carl N, Haggenmüller S, Wies C, Kather JN, Michel MS, et al. Superhuman performance on urology board questions using an explainable language model enhanced with European Association of Urology guidelines. ESMO Real World Data Digit Oncol. 2024;6:100078.
Mirchi N, Bissonnette V, Yilmaz R, Ledwos N, Winkler-Schwartz A, Del Maestro RF. The Virtual Operative Assistant: an explainable artificial intelligence tool for simulation-based training in surgery and medicine. PLoS One. 2020;15(2):e0229596.
Fazlollahi AM, Bakhaidar M, Alsayegh A, Yilmaz R, Winkler-Schwartz A, Mirchi N, et al. Effect of artificial intelligence tutoring vs expert instruction on learning simulated surgical skills among medical students: a randomized clinical trial. JAMA Netw Open. 2022;5(2):e2149008.
Fazlollahi AM, Yilmaz R, Winkler-Schwartz A, Mirchi N, Ledwos N, Bakhaidar M, et al. AI in surgical curriculum design and unintended outcomes for technical competencies in simulation training. JAMA Netw Open. 2023;6(9):e2334658.
Yilmaz R, Bakhaidar M, Alsayegh A, Abou Hamdan N, Fazlollahi AM, Tee T, et al. Real-time multifaceted artificial intelligence vs in-person instruction in teaching surgical technical skills: a randomized controlled trial. Sci Rep. 2024;14:15130.
Yilmaz R, Fazlollahi AM, Winkler-Schwartz A, Wang A, Makhani HH, Alsayegh A, et al. Effect of feedback modality on simulated surgical skills learning using automated educational systems: a four-arm randomized control trial. J Surg Educ. 2024;81(2):275-87.
Giglio B, Albeloushi A, Alhaj AK, Alhantoobi M, Saeedi R, Davidovic V, et al. Artificial intelligence-augmented human instruction and surgical simulation performance: a randomized clinical trial. JAMA Surg. 2025;160(9):993-1003.
Boal MW, Anastasiou D, Tesfai F, Ghamrawi W, Mazomenos E, Curtis N, et al. Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review. Br J Surg. 2024;111(1):znad331.
Winkler-Schwartz A, Yilmaz R, Mirchi N, Bissonnette V, Ledwos N, Siyar S, et al. Machine learning identification of surgical and operative factors associated with surgical expertise in virtual reality simulation. JAMA Netw Open. 2019;2(8):e198363.
Yilmaz R, Winkler-Schwartz A, Mirchi N, Reich A, Christie S, Tran DH, et al. Continuous monitoring of surgical bimanual expertise using deep neural networks in virtual reality simulation. NPJ Digit Med. 2022;5:54.
Lavanchy JL, Zindel J, Kirtac K, Twick I, Hosgor E, Candinas D, et al. Automation of surgical skill assessment using a three-stage machine learning algorithm. Sci Rep. 2021;11:5197.
Gao Y, Vedula SS, Reiley CE, Ahmidi N, Varadarajan B, Lin HC, et al. JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS): a surgical activity dataset for human motion modeling. In: MICCAI Workshop M2CAI. 2014;3:3.
International Committee of Medical Journal Editors. Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals. Updated 2026. Available at: https://www.icmje.org. Accessed 20 August 2026.
Zielinski C, Winker MA, Aggarwal R, Ferris LE, Heinemann M, Lapeña JF Jr, et al. Chatbots, generative AI, and scholarly manuscripts: WAME recommendations on chatbots and generative artificial intelligence in relation to scholarly publications. Colomb Med (Cali). 2023;54(3):e1015868.
Committee on Publication Ethics. Authorship and AI tools: COPE position statement. 2023. Available at: https://publicationethics.org/cope-position-statements/ai-author. Accessed on 20 August 2026.
Flanagin A, Kendall-Taylor J, Bibbins-Domingo K. Guidance for authors, peer reviewers, and editors on use of AI, language models, and chatbots. JAMA. 2023;330(8):702-3.
Cheng A, Calhoun A, Reedy G. Artificial intelligence-assisted academic writing: recommendations for ethical use. Adv Simul (Lond). 2025;10(1):22.
Budzyń K, Romańczyk M, Kitala D, Kołodziej P, Bugajski M, Adami HO, et al. Endoscopist deskilling risk after exposure to artificial intelligence in colonoscopy: a multicentre, observational study. Lancet Gastroenterol Hepatol. 2025;10(10):896-903.
Ray K. AI-assisted colonoscopy and risk of endoscopist deskilling. Nat Rev Gastroenterol Hepatol. 2025;22:672.
Abdulnour RE, Gin B, Boscardin CK. Educational strategies for clinical supervision of artificial intelligence use. N Engl J Med. 2025;393(8):786-97.
Braunstein D, Farooq H, Paolino M, Moynihan A, Cahill RA. Comparative analysis of perceptions on artificial intelligence in surgery: a survey study among surgeons and medical students in Ireland. Ir J Med Sci. 2025;194(6):2341-9.
Omar M, Soffer S, Agbareia R, Bragazzi NL, Apakama DU, Horowitz CR, et al. Sociodemographic biases in medical decision making by large language models. Nat Med. 2025;31:1873-81.
World Health Organization. Ethics and governance of artificial intelligence for health: guidance on large multi-modal models. Geneva: World Health Organization; 2024. Available at: https://www.who.int/publications/i/item/9789240084759 Accessed on 20 August 2026.
Government of India. The Digital Personal Data Protection Act, 2023. New Delhi: Ministry of Electronics and Information Technology; 2023. Act No. 22 of 2023. Available at: https://www.indiacode.nic.in/indiacode/handle/123456789/22037 Accessed on 20 August 2026.
European Parliament, Council of the European Union. Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Off J Eur Union. 2024 Jul 12;L 2024/1689. Available at: https://eur-lex.europa.eu/eli/reg/2024/1689/oj Accessed on 20 August 2026.
Indian Council of Medical Research. Ethical guidelines for application of Artificial Intelligence in Biomedical Research and Healthcare. New Delhi: Indian Council of Medical Research; 2023. Available at: https://www.icmr.gov.in/icmrobject/custom_data/pdf/Ethical-guidelines/Ethical_Guidelines_AI_Healthcare_2023.pdf. Accessed on 20 August 2026.
Eppler M, Ganjavi C, Ramacciotti LS, Piazza P, Rodler S, Checcucci E, et al. Awareness and use of ChatGPT and large language models: a prospective cross-sectional global survey in urology. Eur Urol. 2024;85(2):146-53.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ashwin Vinod, Varun Venkatesh, George Mathew John

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.