Quick, Write!

Inspiration

Inspired by Google's Quick, Draw!, our OCR model is more than just a project; it is a tool designed to aid children with physical limitations, building muscle memory and fine motor skills. Collaborating closely with special education experts, parents, and children, our team actively sought and valued user feedback, ensuring that the resulting application is not only technically efficient but also profoundly user-friendly. We measure our success not just in the accuracy of word recognition but in the transformative outcomes for the children who use our application.

What it does

Quick, Write! is a neural network trained OCR model inspired by Google's Quick, Draw! and our submission into the GDSC With a given word, the neural network will try to guess the word you drew, so, take on the challenge. How good is your hand writing on a mouse? With Quick, Write! Users are able to perfect their handwriting given AI technology and high-level tracking. This project targets the 4th UN Sustainable Development goal (Quality Education) while leveraging Google's Quick, Draw! capabilities.

How we built it

Leveraging Google technologies such as the Quick, Draw! concept, Google Tesseract OCR, openCV, pillow, and flask, our project comprises a user-friendly web interface, providing a holistic experience for a diverse audience. The development of "QuickWrite" followed a strategic and collaborative approach, fusing innovative technologies with a keen understanding of user requirements. Originating from the inspiration of Google's Quick, Draw!, the project commenced with thorough research and engagement with specialized education professionals and potential users, shaping the application's features and design. Our choice of the Quick, Draw! concept and Tesseract OCR was driven by a commitment to reliability and scalability. The development phase emphasized a user-centric design, ensuring an intuitive interface tailored for children. Rigorous testing and iterative refinement were integral to ensuring the precision and efficiency of the word recognition system. The architectural considerations for scalability and adaptability to future enhancements were paramount from the project's inception. Engaging with stakeholders throughout the development process, we aspired to create more than a project but a transformative tool contributing to inclusive education. This journey reflects our commitment to responsible technology and a dedication to making a positive impact on our users' educational experiences.

Challenges we ran into

The most critical challenge we found was the time constraint of the project being 24hrs. The majority of the time designated to us was spent trying to find an idea for the project, and which UN development goals would be best to account for.

We found that working with multiple languages were the most difficult. In particular, having the backend javascript interact with the python modules was quite a challenge. To solve this, we needed to create our own API and have it send the images on screen to the python script. We used Flask to get the words and openCV, and google tesseracts machine learning algorithm to analyze the images. Once the front and backend could communicate with each other, we then had to make sure that it can analyse the images correctly. We used openCV to change the images into ideal conditions for ai ocr analysis. We use image processing techniques like grey scaling, binarizing, skewing, adjusting borders and font analysis. Once we process the images, we can analyse them with google tesseract, and after adjusting many of the parameters, we arrived at a point we feel works well. Getting all these components on their own was not too difficult, but connecting them in an efficient way was the challenging part, luckily, it worked out in the end.

Accomplishments that we're proud of

Amidst tight timelines, "QuickWrite!" has achieved commendable milestones, showcasing the team's resilience and dedication. Notably, the rapid development and deployment of our OCR model within a compressed timeframe underscore our efficiency and agility. We successfully conducted iterative testing phases, ensuring the robustness and accuracy of the word recognition system, all while adhering to strict time constraints. The seamless integration of Google's Quick, Draw! concept and Tesseract OCR into our project was executed with precision, highlighting our team's adeptness in navigating complex technologies within a limited timeframe. Additionally, our ability to gather and incorporate valuable feedback from special education experts and potential users swiftly contributed to the application's user-centric design. "QuickWrite!" takes pride in these accomplishments, demonstrating our capability to innovate and deliver under challenging time pressures, further positioning us as a dynamic force in the technology landscape.

What we learned

Through the intense 24-hour journey of developing our project, we gained invaluable insights into the complexities and challenges of rapid prototyping. One of the most significant lessons we took away from this experience was the paramount importance of meticulous planning. The time constraints illuminated the critical need for a well-thought-out roadmap, as hastily diving into the coding process without a clear strategy proved to be a recipe for setbacks and inefficiencies. Additionally, we discovered the significance of effective communication and collaboration within the team, as seamless coordination played a pivotal role in overcoming unexpected obstacles. In essence, this venture taught us that while the thrill of rapid development is exhilarating, a solid plan is the linchpin that transforms challenges into opportunities for growth and innovation.

What's next for Quick, Write!

Looking forward, "QuickWrite!" is strategically positioned to expand its influence into the healthcare sector, exploring applications that transcend the realm of education. The potential integration of our OCR model in therapeutic interventions for individuals with motor disabilities is a focal point, as we aim to collaborate with healthcare professionals and rehabilitation experts to enhance fine motor skills and hand-eye coordination. Our future trajectory involves cultivating partnerships with esteemed organizations dedicated to skill development and inclusivity, particularly within the disability community. By engaging with specialized educational institutions, rehabilitation centers, and community organizations, we seek to tailor and refine "QuickWrite!" to align precisely with the nuanced needs of diverse user groups. The forthcoming journey of "QuickWrite!" envisions a commitment to promoting independence and achievement among individuals with disabilities, ultimately contributing to improved communication and daily participation within the healthcare domain. Our overarching mission extends beyond education, aligning with a profound vision to empower every individual, regardless of their abilities, through the judicious application of innovative technology.