MSXR - RTA | Keio-NUS CUTE Center

Collaborators

This project was done in collaboration with the SCDF (Singapore Civil Defense Force) and HTX (Home Team Science & Technology Agency)

Overview

The MSXR-RTA training system transforms civil defense training by integrating virtual reality with multi-sensory experiences. This cutting-edge approach enhances realism, safety, and efficiency, equipping emergency responders to manage road traffic accidents and hazmat incidents more effectively, ultimately elevating public safety and setting a new standard in training excellence.

Key Problem(s)

Traditional training methods, which rely on the cutting of physical cars, lack consistency with limited teamwork opportunities, making them resource-intensive and less effective in preparing personnel for real-world emergencies. Typically, SCDF procures scrapped cars for training, where teams of four personnel take turns using extrication tools, while others can only observe. This approach is limited by the availability of scrapped cars, the destructive nature of the training, and weather conditions as it is conducted outdoors. These constraints significantly reduce the frequency and effectiveness of hands-on learning, as well as teamwork capability.

Objective

The project aims to revolutionize SCDF's (Singapore Civil Defense Force) training curriculum by addressing existing challenges listed above and integrating advanced XR (Extended Reality) technology to enhance the trainees' learning experience. The key objective is to build a multi-sensorial simulation system by immersing the trainees in realistic scenarios, engaging their senses of sight, hearing, touch, heat and even smell.

Solution

We've developed an XR training simulation system capable of accommodating up to four trainees in team-based training. It's designed for expansion, allowing incorporation of more hardware instances to support additional simultaneous training sessions. This versatile training covers theoretical and practical aspects and can be seamlessly conducted indoors, unaffected by weather.

The system creates an immersive training experience through multisensorial technology, delivering haptic, thermal, and olfactory responses alongside intricate visuals. As one of the key elements of this multisensorial technology is the addition of elements like burning smells and heat akin to actual conditions. This provides a sense of realism and stress to the trainees which is important to the simulation.

Within this comprehensive multisensorial journey, the first-of-its-kind system integrates hardware that mimics operational tools, accurately simulating weight and generating authentic haptic feedback. This feature enhances muscle memory, especially for non-destructive extrication procedures.

Furthermore, the system meticulously monitors trainee interactions, providing trainers with invaluable data for prompt feedback. This real-time mechanism enhances training by enabling precise guidance from trainers whenever needed

Deployment and Usage

Roughly 200 SCDF officers have engaged in the trial phase of our project's prototype. The positive feedback has been overwhelmingly, especially from young trainees familiar with VR technologies, as it shortens the acclimatization process.

The mentors who have used and taught trainees with the system have expressed strong support and are confident about its capabilities. They are keen on introducing our system across various departments, highlighting its potential for broader adoption. A general consensus is that the system can be seamlessly integrated into the training curriculum at various stages, either to provide novices with an initial exposure or to bridge theoretical knowledge with practical application. There has also been interest from overseas partners with regards to using this system in their countries too.

Impact

The MSXR-RTA simulation project is a groundbreaking initiative that transforms civil defense training through multi-sensory extended reality (XR) technology. Its immersive VR environment, featuring optical, auditory, haptic, olfactory, and thermal feedback, provides unparalleled realism and safety, enabling emergency responders to repeatedly practice high-stakes scenarios in a risk-free setting. This innovation significantly enhances training efficiency, reducing the need for physical resources and instructors while boosting productivity and trainee preparedness.

The project elevates the usage and affirmation of using XR technology for Serious Game adoption, having won prestigious accolades such as the Asia Regional Gold Winner at the Reimagine Education Awards 2023. It sets a new standard for immersive learning, bridging the gap between theoretical knowledge and practical application while fostering technological advancement and economic growth.

Beyond professional training, the MSXR-RTA enhances quality of life by reducing trainee stress, improving confidence, and fostering a mindset open to learning from mistakes. It represents a shift toward agile development methodologies, encouraging collaboration, flexibility, and user-centric innovation. As a transformative force, MSXR-RTA not only redefines simulation training but also establishes Singapore as a global leader in cutting-edge educational technology, with the potential to impact industries and communities worldwide.