medical tr.AI.ning - Virtual Reality Runtime

medical tr.AI.ning is a virtual reality training platform, designed for integration into the medical curriculum to enhance the clinical reasoning capabilities of future physicians.

The platform allows medical students to train clinical competencies from a first-person perspective with virtual, intelligent and interactive patients in an authentic simulated environment. Individual scenarios can be intuitively created by customizing specific parameters regarding patient, pathology and environment to support situated learning.

This repository contains the virtual reality runtime application, used to experience medical scenarios with a virtual reality headset.

Read more about the project

Features

Virtual Anamesis

This project allows you to experience an immersive patient interview and examination simulation in virtual reality with a focus on dermatology.

• Review the individual patient record
• Conduct a patient interview and identify possible risk factors
• Examine the patient's skin for dermatological abnormalities using a dermatoscope
• Take pictures and review the magnified skin condition on a bigger screen
• Ask the patient to undress or change body posture for a more thorough examination

Custom Scenarios

You can create custom environments, patients and scenarios using the supplemented Authoring Tool

Learn how to work with custom scenarios

Usage

Requirements

To run the medical tr.AI.ning VR application the requirements are:

• System capable of running modern VR Applications
• VR-Headset and Controllers (application is targeted towards the Valve Index, but other HMDs can be used as well)
• SteamVR installed

Setup

• Download the newest version from the Releases and extract the files.
• Once extracted, run runtime.exe.
• If you are using a VR Headset which is not the Valve Index, you need to follow this tutorial to rebind the controls in SteamVR

Development

To set up the Unity project and make contributions to the software yourself, these steps must be followed:

Requirements

• Install Unity Editor 2022.3.62f2 using the Unity Hub Application
• In case you don't have it yet, acquire a (free) Unity license in the Unity Hub Application

Cloning the repository

This project uses common assets which are stored in a separate submodule. To ensure that all required assets are present in the project, you need to clone the reposity using the --recurse-submodules option, e.g. git clone https://github.com/medical-tr-AI-ning/vr-runtime.git --recurse-submodules`

Workflow

• Import project folder into Unity Hub using Add project from disk and open the project
• The main scene to run the application is located at Scenes/General/Menu
• The configurable medical environment is located at Scenes/Scenarios/default