Sunday

Inspiration

My grandparents struggled with simple smartphone tasks and often felt helpless. They often feel excluded by tech designed for younger people. I wanted to give them back their digital independence with a tool that truly understands them.

What it does

Sunday is a voice-first assistant built for seniors. It simplifies smartphone use, supports broken English, and enables tasks like calling family, searching, or using apps all hands-free and intuitive.

How we built it

We built Sunday as an Android agent that works in a cycle of Sense → Think → Act. First, the app senses the screen by taking screenshots and reading the XML layout of the phone. Then, it thinks by sending this information into a structured prompt for an LLM, which plans the next action. Finally, it acts by executing typed actions like taps, scrolls, or text input safely on the device. We added a typed action system so that the AI never sends unsafe or meaningless commands. The stack combines multiple technologies: Google Gemini for reasoning, Google STT and TTS for speech, and Picovoice Porcupine for wake word detection. On top of this, we created custom systems like a speech coordinator to stop voice clashes, visual overlays for live transcription, an ondevice memory system for details spoken in chat and a key manager for wake word security. Together, these components create an end-to-end system that is both powerful and senior-friendly.

Challenges we ran into

Making the assistant understand elderly speech patterns and broken grammar.

Avoiding errors when the AI gives imperfect outputs.

Navigating Android’s accessibility and overlay restrictions.

Accomplishments that we're proud of

We created a working prototype that feels natural, coordinates speech without overlap, and executes real UI actions reliably, something not seen in typical assistants.