Inspiration
Our team's inspiration for this project stemmed from our collective interest in technology and problem-solving. Sudoku puzzles offer a structured challenge, making them a perfect fit for exploring computer vision. We decided to integrate augmented reality to enhance the user experience and add a visual twist to solving these puzzles. This project allowed our team to delve into the realms of AI, computer vision, and AR, all while providing a fun and practical solution.
What it does
Our project combines computer vision and augmented reality to create a Sudoku solver. It begins by using computer vision to recognize and digitize the Sudoku puzzle from a physical image and solves the puzzle. Once solved, the augmented reality component kicks in, overlaying the completed Sudoku grid onto the original image or presenting it in a 3D space, allowing users to interact with and explore the solution in a dynamic and visually engaging way.
How we built it
We utilized a tech stack that included OpenCV for Sudoku grid recognition, TensorFlow for number detection, Svelte for the user interface, and Flask for server-side functionality. Flask served as the core framework, enabling seamless communication between the frontend and backend, facilitating puzzle uploads, and delivering the augmented reality Sudoku solving experience via the web application.
Challenges we ran into
One of the biggest challenges we faced throughout this project was actually not the tech aspect but rather the teamwork aspect. Having to manage roles, abilities, and expectations was harder than any of us could've anticipated. What's more, managing a shared GitHub repository and working on several files simultaneously brought forth some issues none of us had dealt with previously. Apart from the teamwork element, the other challenge we faced was that for most of the team, it was our first time interacting with most of this tech stack.
Accomplishments that we're proud of
For sure the biggest accomplishment that we are proud of is the fact that we were able to all come together and work as a team and actually managed to create something special out of it. Regardless of how we place in the competition, we enjoyed the process, have grown a lot from it, and are looking forward to our next hackathon. The second accomplishment that we're proud of is managing to bring all of these tech components together and actually have them work.
What we learned
It's much harder to work on a project with a team that it may seem. Managing expectations between team members, holding each other accountable, and most importantly being honest with each other can be the hardest thing you will deal with as a team.
What's next for PuzzleMage.AI
We are hoping to expand this project into more than just Sudoku. Also freshening up the website is definitely on our to-do list.
Log in or sign up for Devpost to join the conversation.