
R.E.A.C.T.S. VR Medical Training
Jan 2024 - May 2024
Realistic Emergency Aid & Collaboration Training System (REACTS) is a training platform to enhance the skills of medical professionals in varying levels of stressful situations. Leveraging the immersion of XR and generative AI, REACTS creates a realistic and interactive training environment for several different stress scenarios. The prototype enables three to four users to collaborate in various roles. The primary user and the first responder will navigate the virtual environment and perform hands-on medical training such as “stop the bleed” or mental health advising. The secondary user plays the role of a 911 dispatcher and guides the primary user through voice communication while another user acts as a remote medical expert or another on-site responder to offer specialized guidance. An optional fourth user can also be included within the scenarios to provide variability to the training, enhancing learning capabilities and adaptability.
Programs used
Bezi
Unity
Roles
UX Designer
UI Designer
User researcher
Team Members
Mayali Clary
Gavin Bassat
Daniel Tran
Colin Roberts
Shriya Panta
Ethan Kies
Anushka Rao
Press play to watch completed demo video
Task and Mission
-
Create an effective, hands-on virtual training system for the average person training to be a medical professional (i.e., first responders, nurses, etc.)
-
Prepare trainees for various stress-level situations
-
Understand stress levels of trainees after situational training

Main User Persona

Ideation and Design
Storyboard




Hover to click through and view images
For our storyboard, we will be doing a walk through of our system for training a user in a low stress scenario. First the storyboard will walk the user through logging in and then the process of selecting a scenario. The scenario displayed will be a low stress ankle sprain at virtual park, where the user is connected with a medical professional that will walk them through the steps of treating
a patient