Inspiration
During a past hackathon, we encountered a situation where our company required us to fill out an important form. This turned out to be a tedious and time-consuming process, diverting our focus from our actual work.
Sparing a thought to those outside of hackathons, we found ourselves thinking about various examples in people's lives: DS-160 Visa Application, bank loan applications dumped on the illiterate, business license applications, those pesky competitive exam registration forms in our 12th grade year.
We all know how many forms we've dropped out of filling midway as they're asking for too much keyboard input, and on the other hand, how many forms we've created and shared on WhatsApp groups only to hear crickets.
That’s when we realized that form-filling, be it physical or digital, could be made significantly more efficient and user-friendly. This inspired us to develop a solution that simplifies the process and makes it more accessible.
What it does
Our solution transforms any physical or digital form into an interactive voice-enabled form. Users can simply speak their responses instead of manually filling out forms, making the experience faster and more seamless. The system also provides real-time assistance, guiding users through the form-filling process, ensuring accuracy, and reducing errors.
How we built it
At the core of our system, we utilize ElevenLabs' conversation API to enable voice-based interaction. We also built a robust admin tool that allows users to convert forms into voice-enabled versions, generate shareable links, and manage responses via an intuitive dashboard. The combination of these features ensures a smooth and efficient experience for both form creators and respondents.
Challenges we ran into
We faced two major technical challenges while developing this solution:
- Parsing Google Forms correctly – Ensuring accurate extraction and structuring of form data so that it can be efficiently converted into a voice-interactive format.
- Accurate conversation analysis – Understanding user responses correctly and mapping them to the appropriate form fields without errors, especially when dealing with complex or ambiguous inputs.
Accomplishments that we're proud of
One of our biggest achievements is successfully integrating both digital and physical forms into our system. This means that not only can users convert online forms, but they can also digitize paper-based forms and interact with them through voice. This innovation makes form-filling significantly more accessible, particularly for individuals with low literacy levels or disabilities, enabling them to complete forms independently and accurately.
What we learned
Throughout the development process, we discovered numerous possibilities for expanding this tool. We realized that by making targeted engineering optimizations, we could significantly amplify the impact of a simple foundational idea. This experience has taught us how a small automation effort can result in a massive improvement in usability and accessibility.
What's next for ElevenForms
Looking ahead, we plan to expand ElevenForms into a fully-fledged form automation tool with:
- Advanced analytics for better insights into user responses.
- Deeper voice-based interactions for richer feedback, especially useful for feedback forms.
- Support complex form types, including multi-step forms, merged cells, and conditional questions.
- Support for additional form services beyond Google Forms.
- More personalization options for users and organizations.
- Enhanced accessibility features to cater to a wider audience.
- Better channel to reach users: phone calls, visual experiences, WhatsApp audio chats, and so on.
- Confirmation UI for forms requiring high-accuracy
Built With
- appscript
- elevenlabs
- html5
- javascript
- llm
Log in or sign up for Devpost to join the conversation.