Inspiration

We were inspired by the struggles students face managing copious amounts of study material and the difficulty in quickly grasping core concepts. We envisioned a mobile app that acts as a personalized learning assistant, simplifying the learning process and empowering students to study smarter, not harder. We also wanted to leverage the power of AI to create a more interactive and intuitive learning experience.

What it does

The Educational Mobile Application streamlines studying by allowing users to photograph their handwritten notes, typed documents, or even whiteboard equations. The app then processes these images and generates concise, summarized notes for various subjects. It also offers a curated knowledge base for each subject, providing quick access to key definitions, formulas, and important concepts. This allows users to quickly revise and refresh their understanding of specific topics.

How we built it

We built the app using a combination of React Native for the frontend, allowing for cross-platform compatibility (iOS and Android). For the backend, we used NestJs for a modulated nice backend which has good integration with image processing and summary generation. We integrated various uses of the Google Gemini api and the very powerful Wolfram api to generate notes from images, extract mathequations and answer questions . The knowledge base is powered by a PostgreSQL database, and we’re utilizing google cloud storage for user uploads.

Challenges we ran into

Integrating the aforementioned apis seamlessly was a significant hurdle. Ensuring accuracy and handling various handwriting styles and image qualities proved challenging. We also encountered difficulties optimizing the summarization algorithm for different subject matter, as summarizing historical context requires a different approach than summarizing mathematical formulas. Managing the database structure for diverse subjects and ensuring efficient data retrieval also presented some complexities.

Accomplishments that we're proud of

We’re incredibly proud of developing a functional prototype that successfully captures images, extracts text, and generates summarized notes. We've also created an intuitive user interface that is easy to navigate and visually appealing. We are particularly proud of our curated backend endpoints, which offer even mroe functionalities which will be implemented soon.

What we learned

We gained valuable experience in integrating various APIs and working with different technologies. We deepened our understanding of OCR and NLP techniques and the challenges associated with image processing. We also learned the importance of meticulous planning and efficient teamwork in managing a complex project. We especially honed our skills in database management and optimizing queries for performance.

What's next for Power Study

The next phase involves implementing the AI-powered chat functionality, which will allow users to ask subject-specific questions and receive instant, personalized assistance. We also plan to integrate more note summarization functionalities and the ability for users to share and compare thier respective knowledge bases. We aim to expand the subject coverage in the knowledge base and personalize the learning experience based on user progress and preferences. Finally, we’ll explore gamification features to make learning more engaging and rewarding, such as quizzes and progress tracking. We also envision partnering with educational institutions to provide Power Study as a supplementary learning tool.

Built With

Share this project:

Updates