Skip to content

venkatnikhilm/SnapDrobeAPI

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

👓 SnapDrobe

Your AI-Powered Personal Stylist for Snap Spectacles.

SnapDrobe bridges the gap between technology and fashion. By leveraging AR, voice interaction, and the Gemini API, SnapDrobe allows users to build a digital twin of their wardrobe and receive context-aware outfit recommendations—all hands-free.


🌟 Inspiration

Fashion isn't everyone's strong suit. Our team loved technology but struggled with the daily "what do I wear?" dilemma. When we got access to the new Snap Spectacles, we saw a chance to turn a personal pain point into a seamless AR experience. SnapDrobe makes fashion effortless, fun,ed and data-driven by capturing style inspiration the moment you see it.

🚀 What it Does

SnapDrobe transforms how you interact with your closet through simple voice commands:

  • Instant Wardrobe Capture: Spot a piece you love? Say "Add to wardrobe" to capture it via Spectacles.
  • AI-Powered Analysis: Gemini analyzes the image to store structured metadata (color, material, style) in Amazon DynamoDB.
  • Smart Suggestions: Ask for an outfit based on intent (e.g., "I'm going to a rooftop party").
  • Context Awareness: Recommendations are tailored to your existing collection, current location weather, and the time of day.
  • Visual Previews: View an AI-generated mockup of the full head-to-toe look directly in your AR field of view.

🛠️ How We Built It

SnapDrobe is a full-stack AR application built by a team of three:

AR Frontend

  • Lens Studio & TypeScript: Designed the spatial UI and interaction layer.
  • Spectacles Interaction Kit: Handled voice-activated triggers and user input.

Backend & AI

  • FetchAI UAgent Framework: Managed communications between the hardware and cloud.
  • Gemini API: Used for both visual analysis (image-to-JSON) and reasoning (outfit generation).
  • OpenWeather API: Provided real-time environmental context.
  • Amazon DynamoDB: A scalable NoSQL database for personal wardrobe storage.

🚧 Challenges We Ran Into

  • The AR Learning Curve: As first-time Lens Studio users, mastering the Spectacles Interaction Kit and spatial UI positioning was a steep climb.
  • Prompt Engineering for JSON: Ensuring the Gemini API consistently returned structured data for the database required meticulous prompt refinement to avoid parsing errors.
  • Orchestrating Latency: Connecting voice input → weather data → wardrobe retrieval → AI image generation created a complex chain. We had to optimize our FetchAI agents to ensure the user wasn't left waiting in an AR environment.
  • Spatial UI Design: Learning to build interactive, responsive interfaces for an AR/VR environment was completely new territory, requiring us to think about "depth" rather than just "pixels."

🏆 Accomplishments

  • Successfully built an end-to-end system connecting AR wearables to cloud AI.
  • Navigated a production-ready experience in Lens Studio with no prior AR/VR experience.
  • Integrated multiple disparate technologies (FetchAI, Gemini, DynamoDB) into a single fluid workflow.

🔮 What's Next?

  • AR Try-On: Overlay recommended outfits onto the user’s body in real-time.
  • Social Wardrobes: Collaborative styling and "closet sharing" with friends.
  • Calendar Integration: Proactive outfit suggestions based on your upcoming meetings or trips.
  • Style Learning: Personalizing recommendations based on user preferences over time.

🛠️ Built With

  • Hardware: Snap Spectacles (AR/VR)
  • AI: Gemini API
  • Agents: FetchAI (UAgent)
  • Database: Amazon DynamoDB
  • External APIs: OpenWeather API
  • Development: Lens Studio, TypeScript, Python

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors