This project aims to make a personal assistant that utilizes Augmented Reality (AR) technology to help users answer their daily queries and perform tasks with a human touch. The AR feature allows users to interact with the assistant in a more immersive and interactive way, making the experience more engaging.
Some of the use cases such assistant can help you with include:
Getting directions or recommendations in a virtual environment Setting reminders or alarms Playing music or media, and answering questions In addition to these everyday tasks, the assistant also has potential for educational and training purposes. Users can learn new skills or information in a virtual augmented environment, making the learning experience more interactive and engaging.
We are excited to see the potential of this AR assistant and hope it can make a positive impact in people's daily lives. Stay tuned for updates and release!
- Clone the repository to your local machine using Git:
git clone https://github.com/{your-user-name}/AR-Personal-Assistant- Navigate to the project's root directory:
cd AR-Personal-Assistant- Install the required dependencies
yarn install- Start the development server:
yarn run devThe application should now be running locally at http://localhost:3000.
There are mainly 4 use-cases that we provide as follows,
The AR Spotify Music Feature combines the power of Augmented Reality with the vast library of Spotify to take you on captivating musical journeys.
When you access the AR Spotify Music Feature within the app, you'll be greeted with an Augmented Reality experience where you can explore various music genres, playlists, and individual tracks. Each music selection will have its own unique 3D AR assistant accompanying it.
This experience is created with the help of these 4 technologies:
- Blender
- React-Three-Fiber
- WebXR
- Spotify API
Note: The AR experience only works on mobile browsers that support AR, not on laptops or PCs.
The currently available music genres are:
- Chill
- Country
- Hip Hop
- Latin Pop
- Salsa
- Workout
Switch between these genres within the AR experience at your whim, whiile also being able to change yur assistant's configuration to your liking.
If you’re a health freak, but don’t get enough time to go out to the gym then we have you covered here with our Virtual Fitness Trainer. This use case is all about providing a Gym Trainer or Yoga Coach virtually and in a more immersive way for free.
In this service, users will be provided some workouts and yoga to try out. There are dedicated web pages to perform each workout/yoga. On that page they will get more details about that exercise and 3D Virtual Trainers demonstrating that exercise. These 3D animated trainer models are built using Blender and rendered using React Three Fiber
Next, users can actually perform the exercise in front of camera on this platform and the performance will be tracked by our AI-based Body-tracking system built using Tensorflow and Mediapipe. It will keep a track of performed reps or pose time and let the user know via voice making it a hands-free experience.
Last but not least, users can observe the Virtual Fitness Trainer in their own environment by entering the AR mode on their phones. This will actually help users visualize a particular exercise better and understand the best way to do it. This AR experience is also built using React Three Fiber.
All credits goes to these people
Want to help contribute to the development of this project? We welcome any contributions, bug reports, and feedback. Please feel free to open an issue or submit a pull request.
Checkout our contribution guidelines for the project : CONTRIBUTION GUIDELINES
For more information, checkout Notion Page
For any support or help with the installation please open an issue in the Github Repository
Reach us at hi@osenorth.co for any other queries.