Virtual reality and simple AI bring team training for surgery into one room
A new training tool combines multi-user virtual reality with a text-reading AI to help operating room teams practise communication, leadership and decision-making. The aim is straightforward: fewer misunderstandings during surgery and safer care for patients.
Teamwork errors are a known cause of harm, yet most training still focuses on instruments and techniques. At the 2024 SAGES conference, a group of surgeons, anaesthesiologists and engineers introduced the Virtual Operating Room Team Experience (VORTeX) and reported early results from pilot sessions. The work responds to calls in national surgical curricula for practical ways to teach and measure non-technical skills that can be used beyond a single hospital.
Why this is being studied now
Modern surgery depends on coordinated teams. However, structured practice for communication and leadership remains patchy and hard to arrange. Traditional assessments often rely on one instructor’s notes and memory. VORTeX tries to address this gap by offering a shared virtual operating room and consistent, automated feedback.
What the authors see as the core problem
Non-technical skills are essential but difficult to teach at scale. Realistic team drills require space, staff and time, and scoring is subjective. Without clear, repeatable measures, teams struggle to learn from each other and to spot patterns that lead to delays or confusion during emergencies.
A concrete example from the simulator
In one scenario, a routine keyhole operation turns into an emergency when the patient develops a collapsed lung. Each team member must speak up, share observations and agree on next steps. VORTeX records this dialogue and a large language model (a type of AI that reads and classifies text) labels who asked for help, who clarified information and who made decisions. It then draws a simple map of the conversation that shows who spoke to whom and who guided the team. In the pilot, these maps matched what clinicians expect: the surgeon coordinated, nurses often initiated alerts and the anaesthesiologist balanced patient status with the surgical plan.
Main risk the authors highlight
The biggest risk is assuming technical skill alone prevents errors. In fast-moving situations, small lapses in communication can escalate. There is also a risk in using automated scoring without human oversight, or collecting more speech data than is necessary.
What they propose as a remedy
The authors suggest using immersive simulations together with AI-based analysis to give teams quick, consistent feedback and to support structured debriefs. They emphasise that the AI should support instructors, not replace them; scoring methods should be reviewed independently; and data should be handled with clear consent, minimal retention and privacy safeguards.
In summary
Early testers found the system easy to use and useful for practising teamwork under pressure. If further studies confirm these results, virtual team drills with transparent AI analysis could become a practical way for hospitals to strengthen communication and leadership where they matter most: in the operating room.
In a nutshell: A shared virtual operating room, paired with a text‑reading AI, offers a practical way to teach and measure the communication and leadership skills that keep surgical teams on track during emergencies.
- Team communication is as important as technical skill for patient safety, but it is undertrained.
- VORTeX uses VR and a large language model to map who speaks, who leads and how decisions are made.
- AI feedback should be used with instructor oversight and strong privacy rules.
Paper: https://arxiv.org/abs/2601.13406v1
Register: https://www.AiFeta.com
surgery healthcare VR training teamwork AI patientSafety
