README.md

Code for paper: VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots

Authors: Akhil Padmanabha*, Jessie Yuan*, Janavi Gupta, Zulekha Karachiwalla, Carmel Majidi, Henny Admoni, Zackory Erickson

Hardware:

• Obi feeding robot
• Laptop
• External USB-connected mic (optional)

Instructions to use interface:

1. Open two different terminal windows on the laptop
2. In the first window, run python3 /path/to/voicepilot/obi-main.py
3. In the second window, run python3 /path/to/voicepilot/obi-chatgpt-voice.py
4. Say "Hey Obi" into the mic and wait for the beep. After the beep, speak your command to the robot.
5. Let the robot carry out this instruction. The words "Ready for another command" will play to indicate that the robot is done excecuting the previous command and ready for a new one.