EduVoice

EduVoice empowers deaf students with speech-to-text transcription and an EduVoice AI chatbot. Bridging communication gaps for a more inclusive learning environment.

Comment

Inspiration

The inspiration behind EduVoice came from recognizing the significant barriers deaf students face in traditional educational settings. We wanted to create a solution that would provide equal opportunities for all students to engage and excel in their studies. The idea of leveraging advanced technology to bridge communication gaps and promote inclusivity motivated us to develop EduVoice.

What it does

EduVoice is a transformative educational tool that provides real-time speech-to-text transcription and an interactive chatbot. This combination allows deaf students to follow along with lectures and class discussions instantly, ensuring they receive the same information as their hearing peers. The EduVoice chatbot feature assists students by providing immediate clarification and answers, making the learning process smoother and more efficient.

How we built it

EduVoice was built using a combination of powerful technologies and programming languages. We utilized llama3 for the chatbot feature, providing real-time assistance and clarification to students. The WebkitSpeechRecognition API was employed for speech-to-text transcription, ensuring accurate and immediate conversion of spoken words into text. Our codebase includes CSS, HTML, Python, Flask, and JavaScript, spaCy, NodeJS, PyMuPDF, NLTK, and we used Visual Studio Code (VSCode) as our development environment. This combination of tools and languages allowed us to create a robust and user-friendly application.

Challenges we ran into

While developing with LangChain and Ollama libraries, we ran into some technical obstacles. First of all, there was a syntax error since the template string was not correctly formatted, so this needed to be fixed to allow correct prompt formatting. Another concern was that LangChain had started deprecating its predict method; hence, we would need to change over to the invoke method for updated API support. An error message citing that the pip command was not found brought out a different problem with the setup of the virtual environment, which needed troubleshooting to ensure that Python and pip were installed and placed correctly. Such problems call for careful debugging, updating the code in accordance with changes in the libraries, and ensuring proper configuration of the development environment to support the project.

Accomplishments that we're proud of

We are proud of creating a tool that has the potential to significantly improve the educational experience for deaf students. Successfully integrating advanced technologies to provide accurate speech-to-text transcription and a responsive chatbot was a major achievement. Along with that, we are proud of how we implemented spacy and sumy into our PDF to Notes feature as it was new to us.

What we learned

Throughout this project, we learned the importance of accessibility and the impact that innovative solutions can have on improving education for marginalized groups. We gained a deeper understanding of the challenges deaf students face and how technology can be harnessed to address these issues. The process also taught us valuable lessons in teamwork, problem-solving, and the iterative nature of software development. Furthermore, we learnt about how to create an AI 'Chatbot' to a much deeper understanding.

What's next for EduVoice

Looking ahead, we have ambitious plans to further enhance the capabilities of EduVoice. One of our primary goals is to integrate support for multiple languages, allowing the device to pick up and transcribe audio in various languages. This feature would be particularly beneficial in multilingual classrooms and for students studying foreign languages.

Furthermore, we envision EduVoice being equipped with features such as note organization, keyword highlighting, and integration with educational platforms, providing a comprehensive tool that not only aids in real-time comprehension but also supports overall academic success.

We also plan to include an area that can transcribe PDF files from the speech-to-text technology into organized and detailed notes. By continuously evolving EduVoice, we aim to create a future where educational accessibility is no longer a barrier for deaf students, empowering them to achieve their full potential.

Built With

Share this project:

Updates