RemembAR Me

Inspiration

In today's fast-paced world, we're constantly meeting new people—at parties, networking events, business meetings, and social gatherings. Yet, we often struggle to remember the small but meaningful details about the people we meet: their favorite restaurants, shared experiences, or even the context of our last conversation. We've all been in that awkward moment at a party, seeing a familiar face but drawing a blank on their name or how we know them.We were inspired by the fundamental truth that memories define human interactions. The modern world demands that we be hunter-gatherers of social connections, constantly networking and building relationships, but our brains can only hold so much. We envisioned a future where technology doesn't distance us from authentic human connection—instead, it enhances our ability to remember and cherish the people who matter most. With Snapchat's Spectacles, we saw the perfect opportunity to create an AR companion that helps us see beyond the face and into the shared experiences that truly connect us.

The Problem: We Forget

150+ relationships, <20% detail retention
Forgotten conversations damage trust
Memory decay statistics and emotional impact

One Lens, Every Context

Business: Series A discussions, introductions, partnership follow-ups
Hiring: Candidate backgrounds, publications, H1B questions
Friends: Ohio trip, December engagement, ski plans

What it does

RemembAR Me is an AI companion that transforms how you interact with the people around you by recognizing faces and surfacing your shared memories right when you need them. Using Snapchat Spectacles, RemembAR Me:

Recognizes people that matter to you in real-time through the Spectacles camera
Displays cherished memories associated with each person—the last two meaningful interactions you've had together
Provides conversation starters based on your shared experiences, giving you natural pointers to build new memories together
Manages your social network through an intuitive mobile app where you can add friends, store details about them, and organize what you want to remember

Whether you're alone at a party wondering if you know anyone, in a business meeting trying to recall key details about a client, or simply want to have more mindful interactions with loved ones, RemembAR Me serves as your AI wingman—helping you engage authentically and meaningfully with the world around you.

The experience spans three use cases:

Social: Remembering dining memories and friends' favorite spots
Personal: Keeping special moments with loved ones close to heart
Business: Not missing out when things happen quickly

How we built it

We built RemembAR Me as an integrated system combining AR wearables, mobile application, and AI processing: Hardware/AR Layer:

Leveraged Snapchat Spectacles as the AR display platform to provide hands-free, real-time visual overlays Implemented facial recognition capabilities to identify people in the user's field of view

Technical:

Head Binding for facial recognition persistence
RAG with on-premise vector database for encrypted memory storage
Pipeline: Face detect → Head bind → RAG retrieve → LLM generate → AR display (<500ms)
Privacy-first architecture

User Experience:

Designed a seamless flow where the Spectacles display shows memories when recognizing someone
Ensured privacy and discretion in how information is presented through the AR overlay
Built a philosophy around enhancing rather than replacing genuine human connection

Challenges we ran into

Building RemembAR Me presented several interesting topics to consider:

Technical Integration: Connecting the Spectacles hardware with our mobile app and backend systems proved complex. Ensuring real-time facial recognition while maintaining smooth AR overlays required careful optimization and balancing of processing loads between devices.
Privacy and Ethics: We had to carefully consider the ethical implications of facial recognition technology and memory storage. Designing a system that respects privacy while still being useful required thoughtful boundaries and user controls.
User Experience Design: Finding the right balance of information to display was crucial. Too much text overwhelms the user, too little isn't helpful. We iterated extensively on what memories to show, how to present them, and when to surface conversation starters without being intrusive.
Facial Recognition Accuracy: Achieving reliable face recognition in various lighting conditions, angles, and real-world scenarios was challenging. We had to account for people changing appearances over time while maintaining accuracy.
Memory Relevance: Creating an AI system that could determine which memories are most relevant and meaningful to surface at any given moment required sophisticated algorithms and understanding of social context.

Accomplishments that we're proud of

We're incredibly proud of what we achieved with RemembAR Me:

Seamless AR Integration: We successfully created a smooth, non-intrusive AR experience that enhances real-world interactions rather than distracting from them. The information appears naturally in the user's field of view through Spectacles.
Human-Centered Design: We built a system that genuinely prioritizes authentic human connection. RemembAR Me doesn't replace social skills—it enhances them by helping users be more present and mindful in their interactions.
Complete End-to-End System: In a limited timeframe, we delivered a functional prototype spanning AR hardware, mobile application, and AI backend—demonstrating the full vision of how this technology could work in real life.
Innovative Use Case for Spectacles: We pushed the boundaries of what's possible with Snapchat Spectacles, showing how AR wearables can be used for social enhancement rather than just content creation.
Thoughtful Philosophy: Beyond the tech, we're proud of the philosophical foundation we built—the belief that technology should serve as a tool for modern hunter-gatherers, helping us maintain meaningful connections in an increasingly complex social world.

What we learned

This project taught us valuable lessons across multiple dimensions:

AR Development: We gained deep insights into the constraints and possibilities of AR wearable technology, learning how to design interfaces that work in the real world and respect users' cognitive load.
AI Ethics: Working with facial recognition and personal memory data taught us the importance of building ethical safeguards from the ground up, not as an afterthought.
Social Dynamics: We learned that technology for social interaction must be invisible when it's working well—the best social tools enhance connection without making users aware of the technology itself.
User-Centered Iteration: Through testing and feedback, we learned that small details matter enormously in social applications. The way information is presented, timed, and framed can make the difference between helpful and creepy.
Cross-Platform Development: Integrating multiple platforms (AR hardware, mobile, cloud AI) taught us valuable lessons about system architecture, data synchronization, and seamless user experiences across devices.

What's next for RemembAR Me

The future of RemembAR Me is bright, and we have ambitious plans to expand its capabilities:

Enhanced AI Understanding: We plan to implement more sophisticated natural language processing to automatically extract and categorize memories from conversations, making the system more effortless to use.
Contextual Intelligence: Future versions will understand context better—recognizing not just who you're talking to but where you are, what you're doing, and what type of interaction is appropriate (casual, professional, intimate).
Expanded Memory Types: Beyond conversation memories, we want to integrate photos, shared locations, mutual friends, and even emotional context to create richer, more meaningful memory associations.
Privacy-First Sharing: We envision a feature where two RemembAR Me users can opt-in to share and synchronize their memories of each other, creating a collaborative memory space that benefits both parties.
Accessibility Features: We want to make RemembAR Me useful for people with memory-related conditions, social anxiety, or neurodivergence, helping everyone have more confident and authentic social interactions.
Platform Expansion: While we started with Spectacles, we plan to support other AR platforms and even smartwatches, making the technology accessible to more users.
Community-Driven Memories: Building features for group memories and shared experiences, perfect for families, friend groups, and professional teams.

RemembAR Me represents a new era of connections—where technology doesn't distance us from humanity but helps us remember what makes us human: our shared experiences and the people who matter most. We're excited to see where this journey takes us!