StudySync


Inspiration

The inspiration behind StudySync stemmed from the observation that the student learning experience has become increasingly fragmented. We often switch between multiple apps: one for note-taking, another for flashcards, a third for tracking progress, and yet another for recording lectures. This constant context-switching wastes time and makes it harder to stay organized. We wanted to create a unified AI-powered platform that makes studying seamless, personalized, and engaging.

💻 What it does

StudySync is an AI-powered learning companion that combines multiple tools into one web app:

  • EduBot: AI chatbot for Q&A, quizzes, and flashcards.
  • SmartNotes: Real-time lecture transcription & summarization.
  • LearnSphere: Personalized dashboard with progress analytics.
  • NoteSketch: Digital canvas for diagrams and handwritten notes.
  • VoiceBot: Voice-powered AI for hands-free interaction.

How we built it

  • Frontend: Next.js 15, React 19, TypeScript, Tailwind CSS v4, and Framer Motion.
  • Backend/AI: Integrated OpenAI APIs and AssemblyAI for transcription.
  • Database: MongoDB + Google Cloud Provider (GCP).
  • Audio/Video: Used FFmpeg, Web Audio API, and WebAssembly API.
  • Authentication: Implemented Google OAuth 2.0.
  • Hosting: Deployed on Vercel with external API services & GCP.

Challenges we ran into

We discovered that using a standard Voice-To-Voice AI was consuming excessive computing resources, so we designed our own custom Voice-To-Voice AI utilizing WebSockets, live Speech-To-Text, and Text-To-Speech to deliver a seamless and enhanced user experience.


Accomplishments that we're proud of

  • Integrated Platform: Built a fully integrated platform that combines six separate study tools into one seamless app.
  • Real-time Voice AI: Implemented real-time AI-powered voice interaction, enabling hands-free learning.
  • Conversational AI: Successfully created a conversational & responsive voice-to-voice AI with low latency.
  • Scalable Backend: Designed a scalable backend with MongoDB and WebSockets to support real-time features.
  • Secure Deployment: Deployed the app on Vercel with secure Google OAuth authentication, ensuring accessibility and security.
  • Project Delivery: Overcame technical challenges to deliver a unified, polished, and user-friendly platform within a limited timeframe.

What we learned

We learned how to build and integrate multiple AI-powered modules into a single web app, from connecting APIs like OpenAI and AssemblyAI to handling real-time voice features with WebSockets. We gained hands-on experience with MongoDB for data management, Vercel for deployment, and Google OAuth for authentication, which taught us how to create a secure, scalable application. Beyond the technical side, we also learned how to collaborate effectively as a team, divide responsibilities, and deliver a cohesive project.


What's next for StudySync

We plan to expand StudySync by building a mobile app so students can learn on the go and adding multi-language support to make it more inclusive. We also aim to enhance LearnSphere with deeper analytics, integrate with more learning platforms like Canvas and Google Classroom, and explore partnerships with universities to pilot the tool with real students. In the long term, we see potential for StudySync to evolve into a full ed-tech SaaS platform that empowers learners globally.

Built With

  • assemblyai
  • ffmpeg
  • framermotion
  • googleoauth
  • next.js
  • openai
  • openaitts
  • react
  • tailwindcss
  • typescript
  • vercel
  • webaudio/webassemblyapi
Share this project:

Updates