noted.

Project Story: noted – Object Finding Reimagined for the Visually Impaired

(In-person)

About the Project

noted is an assistive mobile app that helps blind and visually impaired users locate personal items using simple, spoken directions.

By using your phone’s camera to understand your environment, noted remembers where important objects are. Later, when you ask “Where are my keys?”, noted responds with clear voice instructions like “Walk forward,” or “Turn slightly left.”

There are no screens to read and no confusing sound patterns: just real-time, human-friendly guidance.

What Inspired Us

We were inspired by the daily frustrations that come with misplacing items: something we all experience, but which can be especially disempowering for those without sight.

Most existing tools rely on visual UIs or tiny Bluetooth tags.

We asked: What if you could just ask out loud, and hear clear directions in return?

noted was born from that idea: a calm, voice-first assistant that helps people find their way back to what matters most.

How We Built It

Camera-based object memory: noted uses the phone’s camera to identify and store object locations indoors.
Natural voice directions: Instead of beeps or buzzes, noted gives step-by-step audio cues: “Turn left,” “Walk 2 steps forward,” etc.
Memory logging: Users can say things like, “I left my wallet in the bedroom,” and noted will remember that location.
Designed for voice + screen reader users: Minimal visuals, high contrast, and full voice navigation flow.

Challenges We Faced

Simulating non-visual interactions in Figma meant we had to get creative with how we demonstrated spoken flow and spatial guidance.
We iterated on how to phrase voice instructions so they feel natural and clear.
Balancing independence with support: we wanted users to feel fully in control, while also allowing trusted contacts to contribute if needed.

What We Learned

Simplicity is powerful. A clear voice saying “take two steps forward” can be more helpful than complex maps or beeping tones.
Accessibility isn’t a constraint: it’s a creative lens that leads to more thoughtful design.