Skip to content

Samples

danbohus edited this page Mar 3, 2022 · 16 revisions

The psi-samples repository contains a few small example applications written with Platform for Situated Intelligence. Some of the samples address specialized topics like how to leverage speech recognition components or how to bridge to ROS, but in general looking through them can give you more insight into programming with Platform for Situated Intelligence. Besides these samples, a good place to start reading about programming with \psi is the Brief Introduction and the set of Tutorials.

As indicated in the last column in the table below, some of the samples have a corresponding detailed walkthrough that explains how the samples are constructed and function, and provide further pointers to documentation and learning materials. Going through these walkthroughs can also help you learn more about programming with \psi.

Name Description Windows Linux Walkthrough
HelloWorld
Hello World preview image showing code snippet
This sample is the simplest possible starting point for creating a \psi application. Yes Yes Yes
SimpleVoiceActivityDetector
Preview image showing visualized audio and VAD result streams
This sample captures audio from a microphone and performs voice activity detection, i.e., it computes a boolean signal indicating whether or not the audio contains voiced speech. Yes Yes Yes
WebcamWithAudioSample
Preview gif showing webcam view of a person speaking and audio level changing
This sample illustrates how to display images from a camera and the audio energy level from a microphone. Yes - Yes
LinuxWebcamWithAudioSample This sample illustrates how to display images from a camera and the audio energy level from a microphone on Linux. - Yes Yes
AzureKinectSample
Sample output from Azure Kinect sample showing ASCII art of a person waving
This sample demonstrates how to use the Azure Kinect sensor with body tracking and how to use the Join() and Pair() operators to synchronize and fuse streams. Yes - Yes
WhatIsThat
Preview gif of visualized 3d output from What-is-That sample
This sample implements a simple application that uses an Azure Kinect sensor to detect the objects a person is pointing to. Yes - Yes
PsiBot
Preview image of the Teams Bot integration sample - a ball bouncing between the active speakers
This sample application shows how you can integrate \psi with the Teams bot architecture to develop bots that can participate in live meetings. Yes - Yes
KinectSample This sample illustrates how to augment an existing voice activity detector by leveraging information about lips motion extracted from Kinect face tracking. Yes - -
SpeechSample This sample illustrates how to use various speech recognition components. Yes - -
LinuxSpeechSample This sample illustrates how to use various speech recognition components on Linux. - Yes Yes
RosTurtleSample
Preview image of Ros Turtle sample
This sample illustrates how to connect Platform for Situated Intelligence to the turtlesim in ROS. Yes Yes Yes
RosArmControlSample This sample illustrates how to connect Platform for Situated Intelligence to control the uArm Metal using ROS. Yes Yes Yes
OpenCVSample This sample illustrates how to interop with OpenCV. Yes - -
HoloLensSample
Preview gif of visualized output streams from one of the HoloLens Sample demos
This sample demonstrates how to develop Mixed Reality \psi applications for HoloLens 2. UWP - Yes
Clone this wiki locally