WayFinder AI: Your Personal Exploration Companion
💡 Inspiration
We built this project to solve a universal problem: the struggle of deciding where to go and what to do, whether you're at home or exploring a new place. From the simple scenario of being bored on a lazy Sunday afternoon to the more complex situation of being lost in a foreign country, WayFinder AI aims to be your personal exploration companion.
Use Cases
- Everyday Exploration: When you're bored at home and want to discover new local spots
- Tourist Experience: Exploring a new city with personalized recommendations
- Emergency Situations: Finding essential services when lost in an unfamiliar place
- Cultural Immersion: Discovering authentic local experiences beyond tourist traps
- Accessibility: Helping people with navigation challenges explore their surroundings
- Social Planning: Finding the perfect spot for group meetups or dates
- Business Travel: Efficiently discovering relevant places during work trips
- Educational Tours: Learning about historical and cultural landmarks
🎯 What It Does
Our AR Tour Guide transforms your Spectacles into an intelligent exploration companion that:
- Guides in Real-Time: Provides instant recommendations based on your location
- Personalizes Experiences: Uses AI to understand your preferences and interests
- Enhances Discovery: Shows AR overlays with information about nearby places
- Ensures Safety: Helps you find essential services and safe routes
- Saves Time: Eliminates the need for manual research and planning
🛠️ How We Built It
Backend Architecture
- FastAPI Server: Handles requests and manages data flow
- Fetch.ai Agents: Process location data and make intelligent recommendations
- OpenAI Integration: Provides natural language understanding and generation
- Snap Places API: Fetches real-time location data and place information
Frontend Development
- Lens Studio: Built the AR interface for Spectacles
- Interactive Map: Created with drag-and-drop pin functionality
- AR Visualization: Implemented layered information cards and 3D elements
- Real-Time Updates: Ensured smooth data synchronization
AI Integration
- Autonomous Agents: Process user preferences and location data
- Natural Language Processing: Understands and responds to user queries
- Recommendation Engine: Suggests personalized tour routes
- Context Awareness: Adapts to changing conditions and user needs
🚧 Challenges Faced
Interactive Map Features
- Implementing drag-and-drop functionality for map pins in AR
- Ensuring smooth interactions while maintaining AR stability
- Balancing performance with visual quality
System Integration
- Linking the Fetch.ai agent with the Snap Places API
- Synchronizing data flow between backend and AR frontend
- Managing real-time updates across different systems
AR Visualization
- Properly layering AR elements in Spectacles
- Managing visual clutter while maintaining information density
- Optimizing rendering performance for smooth AR experience
AI Integration
- Coordinating multiple AI systems (Fetch.ai and OpenAI)
- Ensuring real-time response from autonomous agents
- Maintaining context across different AI interactions
🌟 Future Plans
We have exciting plans to enhance the project:
- Adding more interactive features and categories to the map
- Implementing 3D visualization of places and routes
- Enhancing the AI recommendation system with more contextual awareness
- Improving the AR interface with more intuitive interactions
- Adding social features for shared tour experiences
- Implementing offline capabilities for areas with limited connectivity
This project represents our vision of making exploration more accessible, engaging, and personalized for everyone, anywhere in the world.
Built With
- fastapi
- fetch.ai
- gpt4
- openai
- python
- snapspectacles
- typescript
Log in or sign up for Devpost to join the conversation.