Medical Simulations

Creating Affordable and Accessible Training

On May 25th, 2023 my teammates and I were briefed on the next project we would be working on. A simulation that would immerse medical professionals at AdventHealth. On June 22nd, 2023 we were presenting our simulation environment to AdventHealth executives.

The problem we solved was that the hospitals would often need to fly patients to different facilities for higher levels of care but they didn't have enough aircraft to use in training scenarios and the handful of times they could, it was cost prohibitive. This environment was specifically set up for patients that were connected to an ECMO (ExtraCorporeal Membrane Oxygenation) machine. The machine itself can easily run into issues in hospitals with plenty of staff and equipment on hand. Having a patient hooked up to the machine on a helicopter or fixed-wing aircraft adds a lot of risk if something goes wrong. There is less room to move around the patient and less equipment to assist medical professionals.

We were able to create a solution leveraging Varjo XR3 headsets and green screen chroma keying. With the fidelity of the headsets and a proper key, we were able to fully immerse our clients in the simulation. Using green screen allowed them to use their already existing training apparatus for the ECMO machine. We created haptic feedback for the chairs, integrated a communication system for in-flight comms, and had the helicopter fly around a digital twin of Orlando, Florida.