SHIVR

Subtle Haptics in Virtual Reality (SHIVR)

SHIVR is an innovative SDK that empowers developers to integrate vibrotactile haptic feedback with Ultraleap hand tracking for refined, subtle hand interactions within Virtual Reality (VR) environments. SHIVR is designed to elevate VR experiences, providing users with a deeper sense of immersion and engagement through nuanced tactile sensations.

Table of Contents

• Overview
• Features
• Technology Stack
• Installation
• Usage
• Development Process
• Challenges and Solutions
• Future Work
• Team
• Demo and Showcase

Overview

SHIVR enhances the VR landscape by incorporating subtle haptic feedback into hand-tracking interactions. This innovation enriches the realism of VR environments and boosts user engagement by seamlessly blending tactile sensations with natural hand gestures.

Features

• Precise Hand Tracking: Utilizes Ultraleap technology for detailed hand gesture recognition.
• Vibrotactile Haptics: Implements ESP32 and vibration sensors for nuanced haptic feedback.
• Seamless Integration: Compatible with Unity and various VR platforms.
• Enhanced Realism: Provides subtle feedback to improve interactivity and immersion.

Technology Stack

• Hardware:

Ultraleap hand tracking device ESP32 microcontroller Arduino Uno (for specific prototyping purposes)

• Software:
  • Development Platform: Unity
  • SDKs and Tools: Custom-built algorithms for haptic response, integration support for Oculus
• Operating System: Compatible with various platforms supporting Unity

Installation

1. Set up your VR hardware, including Ultraleap and ESP32 connections.
2. Clone the SHIVR repository to your local system.
3. Open the project in Unity.
4. Connect ESP32 and load the firmware using Arduino IDE as necessary.
5. Import the required hand tracking SDKs and custom SHIVR scripts.
6. Build and run the project on your VR platform.

Usage

1. Launch the SHIVR-enabled application in Unity.
2. Use Ultraleap-enabled hand gestures to interact within the VR environment.
3. Experience subtle haptic feedback that adjusts based on hand movements and interactions.
4. Modify or customize the feedback settings through Unity for tailored user experiences.

Development Process

1. Conceptualization: Identified the need for subtle, vibrotactile feedback to complement visual and auditory VR cues.
2. Prototyping: Developed initial hand-tracking modules with haptic integration using ESP32 and vibration sensors.
3. Integration and Testing: Refined haptic feedback synchronization to ensure fluid, responsive interactions in VR.
4. User Testing: Collaborated with testers to gather insights and adjust feedback frequency for maximum effectiveness.

Challenges and Solutions

Challenge	Solution
Synchronizing hand tracking with feedback	Optimized response algorithms for real-time interaction
Ensuring seamless feedback integration	Leveraged ESP32 firmware customization
Limited access to hardware during testing	Utilized simulations and virtual testing environments

Future Work

• Enhancing compatibility with more VR platforms.
• Introducing adaptive feedback for various hand gestures.
• Expanding applications for training simulations and interactive VR storytelling.
• Adding customizable user settings for haptic intensity.

Team

This project received the 'Best use of hardware' award at Immerse The Bay at Stanford University 2023 organized by Stanford XR Club

It was made possible by the collaboration and expertise of the SHIVR team, dedicated to enhancing VR through the intersection of tactile feedback and cutting-edge technology.