Lobby
Bookshelf/Document Upload
Document reader
Multiple choice question
Visual/Focus Optimized video with audio and text
Visual/Focus Optimized video with audio and text

About the Project

🌟 Inspiration

One of my best friends is dyslexic. Growing up, I loved reading books, but he struggled and didn’t get to enjoy them the same way. Instead, he used a web app called MyOn, which combined pictures with audio narration. But there was a big limitation—he could only access existing books from their library. He couldn’t upload his own novels, class documents, or notes.

That gap inspired our project: a platform where any document can be transformed into a personalized, adaptive learning journey. By letting students upload their own files and turning them into accessible chunks, we wanted to remove the walls that once kept learners like my friend from enjoying and understanding the same content.

📚 What We Learned

The importance of personalization: every learner benefits from different combinations of audio, visuals, and text.
That accessibility means more than TTS—it means adaptive simplification, pacing, and feedback.
Technical lessons in Flask, text processing, chunk generation, AI-powered summarization, and gamified quiz design.
How to balance user experience with backend complexity in a short hackathon timeframe.

🛠️ How We Built It

Upload Document → User provides a .pdf or .txt file.
Chunking & Simplification → Text is broken into small, dyslexia-friendly segments.
Learning Modes →
- Auditory-first: Audio narration with word highlighting.
- Visual-first: Simplified text with key terms in bold.
- Mixed: Audio + simplified text (dual coding).
Checkpoints → Short quizzes after each chunk.
- Correct streaks = larger future chunks.
- Incorrect streaks = simplified, shorter chunks, slower TTS.
Gamification → +5 points for each correct answer, making learning feel rewarding.
Stretch Goal → A community-driven library of pre-optimized, dyslexia-friendly lessons.

🚧 Challenges We Faced

Dynamic adaptation that responds to learner performance in real time.
Summarizing while preserving meaning across varied documents.
Accessibility-first UI that stays clear and non-distracting.
Hackathon time pressure while shipping a real MVP.
Integrating a Minecraft parkour video into our 3D scene (CORS/tainted canvas and texture timing issues).
Configuring the Gemini API to craft effective prompts and consistently generate relevant, level-appropriate checkpoint questions.

✨ Closing Thought

Where MyOn gave access to pre-selected audiobooks, our app gives dyslexic learners the power to transform any document into a journey they can follow—accessible, adaptive, and gamified. By partnering with schools and nonprofits, we aim to make this resource free and available to students everywhere.