Granny AI
A voice-controlled desktop agent for people who find computers difficult to use. You describe what you want, and the app interprets the request and carries out the navigation.
2026
ElectronGemini APIElevenLabsPlaywrightReactTypeScript
01
Starting with a spoken request
Granny AI is a desktop-agent prototype for people who find a computer difficult to operate. ElevenLabs handles speech, Gemini interprets the request, and the Electron app brings the interaction together. The user describes a task rather than navigating each step themselves.
02
Why we changed the control method
The first version drove the mouse directly. That proved unreliable, so we rebuilt the execution around Playwright browser automation and application launching. It was a useful change in scope: the agent needed a dependable way to carry out actions after interpreting a request.
In pictures
