Build a voice-controlled hub for family chores and devices
A poster made a household voice agent that updates lists, plans meals, tracks chores, and runs smart-home gear by voice.
- What they did
- They spent five weeks assembling a shared home assistant on a Python backend with Google ADK, Gemini Live on Vertex, a Memory Bank, and separate MCP servers tied to kitchen data, an e-paper board, and Home Assistant. The system takes spoken requests for shopping lists, meal ideas, recipes, calendar entries, chores, reminders, lights, and the robot vacuum. Quick home actions are handled with pattern matching, more involved ones are sent to Claude, and every step shows up as a card that can be undone. The poster managed the architecture and review, while Claude Code produced the code.
- How it went
- It ended up available as the family assistant on their phone, kitchen screen, car, desktop, watch, and widget. They said the ghost-themed interface is what nudges them to open it. Two problems they mention are that Gemini Live reads text that only appears on-screen, and an over-the-air CPU clock change caused the kitchen board to boot-loop.
- Tips
- They found that a good CLAUDE.md in every repo made the biggest difference. For a similar build, keep the first version narrow and make sure each action can be reversed.
Try it yourself with Claude Code
I want to create a home voice assistant for [number] people that can manage shopping lists, meal planning, recipes, a shared calendar, chores, and reminders, and also control [lights / a robot vacuum / other smart-home devices]. Start by designing a small working version that accepts voice commands and fully completes one shopping-list update and one chore task. Walk me through how to test it by voice, and stop to ask for my approval before you connect any account, device, payment, sending, deleting, or other irreversible action. After the first two features work, suggest how to extend it to [phone / kitchen display / car / desktop / watch / widget].
Fill in the [brackets]. Agents can make mistakes, so review anything before it is sent, paid or deleted.
Get 3 agent uses like this every morning
With the day's top AI news. Free, and one click to unsubscribe.
Related agent uses
Use your phone to steer a PC game launch
A writer used Claude Code to handle simple desktop chores and start World of Warcraft from a phone-linked PC.
Use Gemini to book and move events by voice
A writer used Gemini on a phone to add calendar events, spot clashes, and shift meetings without typing.
Turn a Lichess game into a narrated review video
A developer used Claude Code to blend engine analysis with spoken notes and make a commented video of a chess game.
Use Claude Code for everyday admin tasks
They set up Claude Code skills to check trash pickup, arrange a lower-cost inspection, update the calendar, and send regular briefs from messages and email.
Automate next-day school packing reminders
Claude Code helped a parent turn school and activity emails into calendar entries and WhatsApp packing alerts.
Use Claude Code to maintain Home Assistant automations
Adam relied on Claude Code plus an MCP server to inspect Home Assistant, edit automation YAML, and troubleshoot behavior from traces.