Flagship system
Pixie
An embodied AI learning companion.
In active development
React · Three.js · Rapier · Gemini Live API
Overview
Pixie talks, listens, remembers, and grows with the child using it. Real-time bidirectional voice over Gemini Live API, physics-based locomotion, synchronous spatial tool execution, and amplitude-driven lip-sync — built neurodivergent-first, so predictability and sensory pacing are first-class constraints.
What it does
- 1.Voice-native interaction with real tool use — Pixie does things, not just says things.
- 2.Long-term memory built on the lab's architecture research: learned context persists, decays, consolidates.
- 3.Embodied presence — a 3D character with continuity of personality, desktop-native.
- 4.Observer mode: pointer heatmaps driving context-aware spatial commentary.
Why it exists
A learning companion is only useful if it remembers — a tutor with amnesia is a stranger every morning. Every lab program feeds this system.