Mind-bending VR at your eartips!

[Remi-Gau]

Added as an issue for book keeping

Source: https://brainhack.ch/

Team Leaders:

Konstantinos Samaras-Tsakiris and Victor Férat

Concocting together electroencephalogram (EEG) earbuds, Virtual Reality (VR) and neural feedback… what can come out of this sci-fi melting pot? Join us to create the most immersive experience that goes a step further from VR, adapting to your mental state.

Neurofeedback is a technique with established therapeutic and educational potential. We are interested to create neurofeedback in virtual reality environments using EEG sampled only from inside the ear. We will combine a novel EEG sensor shaped like earbuds and a VR headset to immerse the participants in an environment where they can control a tunable parameter (eg. the gravity!) with their own brain activity. The comfortable form factor of the EEG earbuds can facilitate deeper immersion in the experience, potentially boosting the neurofeedback effect.

But how can we translate the neural signal into meaningful action? Most published research indicates neuromarkers in standard, full-scalp EEG; much less is known about in-ear EEG. In this project we aim to bring together translatable neuromarkers and machine learning to bridge the gap in the feedback loop and give the subject a "mental exercise" that will help them navigate the virtual world.

Over the weekend we can also build a fledgling VR game starting from Unity engine demos to amplify the effect of neurofeedback and make it even more visible. We’ll use the Meta Quest 2 VR headset.