-
Notifications
You must be signed in to change notification settings - Fork 100
Samples
The psi-samples repository contains a few small example applications written with Platform for Situated Intelligence. Some of the samples address specialized topics like how to leverage speech recognition components or how to bridge to ROS, but in general looking through them can give you more insight into programming with Platform for Situated Intelligence. Besides these samples, a good place to start reading about programming with \psi is the Brief Introduction and the set of Tutorials.
As indicated in the last column in the table below, some of the samples have a corresponding detailed walkthrough that explains how the samples are constructed and function, and provide further pointers to documentation and learning materials. Going through these walkthroughs can also help you learn more about programming with \psi.
Name | Description | Windows | Linux | Walkthrough |
---|---|---|---|---|
HelloWorld |
This sample is the simplest possible starting point for creating a \psi application. | Yes | Yes | Yes |
SimpleVoiceActivityDetector |
This sample captures audio from a microphone and performs voice activity detection, i.e., it computes a boolean signal indicating whether or not the audio contains voiced speech. | Yes | Yes | Yes |
WebcamWithAudioSample |
This sample illustrates how to display images from a camera and the audio energy level from a microphone. | Yes | - | Yes |
LinuxWebcamWithAudioSample | This sample illustrates how to display images from a camera and the audio energy level from a microphone on Linux. | - | Yes | Yes |
AzureKinectSample |
This sample demonstrates how to use the Azure Kinect sensor with body tracking and how to use the Join() and Pair() operators to synchronize and fuse streams. |
Yes | - | Yes |
WhatIsThat |
This sample implements a simple application that uses an Azure Kinect sensor to detect the objects a person is pointing to. | Yes | - | Yes |
PsiBot |
This sample application shows how you can integrate \psi with the Teams bot architecture to develop bots that can participate in live meetings. | Yes | - | Yes |
KinectSample | This sample illustrates how to augment an existing voice activity detector by leveraging information about lips motion extracted from Kinect face tracking. | Yes | - | - |
SpeechSample | This sample illustrates how to use various speech recognition components. | Yes | - | - |
LinuxSpeechSample | This sample illustrates how to use various speech recognition components on Linux. | - | Yes | Yes |
RosTurtleSample |
This sample illustrates how to connect Platform for Situated Intelligence to the turtlesim in ROS. |
Yes | Yes | Yes |
RosArmControlSample | This sample illustrates how to connect Platform for Situated Intelligence to control the uArm Metal using ROS. | Yes | Yes | Yes |
OpenCVSample | This sample illustrates how to interop with OpenCV. | Yes | - | - |
HoloLensSample |
This sample demonstrates how to develop Mixed Reality \psi applications for HoloLens 2. | UWP | - | Yes |
- Basic Stream Operators
- Writing Components
- Pipeline Execution
- Delivery Policies
- Stream Fusion and Merging
- Interpolation and Sampling
- Windowing Operators
- Stream Generators
- Parallel Operator
- Intervals
- Data Visualization (PsiStudio)
- Data Annotation (PsiStudio)
- Distributed Systems
- Bridging to Other Ecosystems
- Debugging and Diagnostics
- Shared Objects
- Datasets
- Event Sources
- 3rd Party Visualizers
- 3rd Party Stream Readers
Components and Toolkits
- List of NuGet Packages
- List of Components
- Audio Overview
- Azure Kinect Overview
- Kinect Overview
- Speech and Language Overview
- Imaging Overview
- Media Overview
- ONNX Overview
- Finite State Machine Toolkit
- Mixed Reality Overview
- How to Build/Configure
- How to Define Tasks
- How to Place Holograms
- Data Types Collected
- System Transparency Note
Community
Project Management