Skip to content

Using multimodal sensing and communication with users: audio, visual, text.

Notifications You must be signed in to change notification settings

qjiang002/multimodal

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

89 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

multimodal

Using multimodal sensing and communication with users: audio, visual, text.
The current steps to run the whole system
Step 1: Open ActiveMQ on your computer.
Step 2 : Put the files "start files" into the root of original vhtoolkit . Then open VHTtoolkit through "ys-run.bat" (Java vesion 11.0) Step 3 : Open PSI(Demo V2) in the visual studio, run "program.cs".In this step, you need to install some NuGet packages of PSI to build the environment. The packages you may need are:Microsoft.Psi.Interop;Microsoft.Psi.Imaging;Microsoft.Psi.Media.Windows.x64;Microsoft.Psi.MicrosoftSpeech.Windows;Microsoft.Psi.Runtime;Microsoft.Psi.Runtime.Windows;Microsoft.Psi.Speech;Microsoft.Psi.Speech.Windows.For futhure infomation, you can see at PSI official page: https://github.com/microsoft/psi/wiki/Building-the-Codebase
Step 4 : Open RealSense through "StartClient.py"
Step 5 : Open Bazaar

About

Using multimodal sensing and communication with users: audio, visual, text.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • HTML 35.1%
  • C# 29.2%
  • Java 18.2%
  • C 10.9%
  • AngelScript 1.8%
  • JavaScript 1.6%
  • Other 3.2%