Real-time memory: Honcho’s async API is designed for live voice interactions. Messages persist in the background without blocking audio, and the dialectic API returns user context fast enough for mid-conversation tool calls.
GitHub Repository
Full source code
Build Livestream
Watch us build it live
What It Does
- Face recognition identifies users and loads their personal memory
- Honcho stores conversations and reasons about each user over time
- OpenAI Realtime handles low-latency voice interaction
- Gaze tracking maintains eye contact during conversation
Setup
Architecture
Honcho Integration
Initialize Honcho with a robot peer (not observed) and dynamic user peers (observed):Memory Tools
The robot calls Honcho mid-conversation via OpenAI function calling — fast enough for real-time voice:Multi-User Support
Face recognition identifies returning users. When a new face is detected, the agent:- Flushes pending transcripts to the previous user’s session
- Switches Honcho context to the new user
- Fetches a briefing from Honcho’s dialectic API
- Reconnects OpenAI with fresh context and triggers a greeting
System Prompt
Run
Next Steps
Honcho Architecture
Understand peers, sessions, and reasoning
Chat Endpoint
Learn about Honcho’s dialectic API
Get Context
Retrieve formatted conversation history
GitHub code
Dig into the code