Inspiration
At a recent seminar, a State Farm official shared their struggle as a deaf and mute individual who relied on lip-reading to communicate. The onset of COVID-19 worsened their challenges. This prompted us to develop "Sign Seeker," a groundbreaking program. Sign Seeker addresses communication barriers faced by the deaf and mute, especially in meetings.
What it does
It leverages advanced technology to enhance their participation. Our commitment to inclusivity drives us to continually improve Sign Seeker, making it an invaluable resource for communities facing similar challenges. This program exemplifies our dedication to solving real-world issues and fostering positive change in a constantly evolving world.
How we built it
"Sign Seeker" was born from a State Farm official's struggles as a deaf and mute individual exacerbated by COVID-19. We developed a program using advanced technology for real-time speech-to-text and sign language interpretation, promoting inclusivity and addressing communication challenges. It represents our commitment to positive change in an evolving world.
Challenges we ran into
Learning to integrate this with AWS and finding sample data to train the model were the hardest part.
Accomplishments that we're proud of
"Sign Seeker" has received widespread recognition and support, including funding and collaboration offers from leading technology companies. This acknowledgment reflects the project's success in addressing communication barriers for the deaf and mute community, marking a significant milestone in our mission to foster inclusivity and accessibility.
What we learned
Developing "Sign Seeker" taught us how to integrate Amazon Web Services (AWS), hone problem-solving skills, work efficiently in a tight timeframe, and the essential value of teamwork. These lessons enriched our technological and project management capabilities, fostering inclusivity and accessibility in the process.
What's next for Sign Seeker
Sign Seeker's future includes a dedicated mobile app for accessibility on the go, integration into diverse applications, and the development of a web browser extension. These advancements will further enhance communication inclusivity, benefiting the deaf and mute community across various platforms and settings.
Built With
- amazon-dynamodb
- amazon-web-services
- mediapipe
- numpy
- opencv
- pytoch
- sagemaker
- yolox

Log in or sign up for Devpost to join the conversation.