Pandojo

Inspiration

We were discussing ideas for this hackathon and at first things were rough. We tried exploring some topics, diving deeper, thinking about which problems we had lately. However nothing truly piqued our interest. Then, one of us started rambling about wanting to try a martial art, but he isn't sure if it's worth it for so much trouble of travelling to the location, paying a membership, that can only be cancelled after a few months, and communicating with people, who you're not sure if you'll like. What happened after was an incredible chain of ideas, that perfectly fit with each other and which we all actually loved. We were all very involved with this idea from the start, because it's something we would absolutely use.

What it does

Our main goal is to give people an option to learn a martial art, without the constraints of your physical location, and social and financial issues. We are using a system of different levels for each course, that make learning feel like a fun game, while also rewarding you for your achievements, such as finishing a course, or keeping up a streak of continuous log-ins. The technology, that helps our users with their sports journey is a trained AI, that will take a video of you doing a move and give you advice on how to improve yourself! You can also have your own customizable Panda, who will improve with you, and then challenge your friends in battle, to keep the competitive spirit and give people the possibility to connect and learn with friends through Pandojo.

How we built it

We used a variety of different programming languages, frameworks and libraries, such as Java with SpringBoot, Dart with Flutter, and Python. From out data scientist: using the mediapipe library, we define 31 points on a human body, which are responsible for limbs and joints. Then, using Dynamic Time Warping(DTW) Algorithm we analyze projections and the position of the main points of our right leg and give a response on whether you executed a move correctly. Front-end: using flutter framework we built an app that is built upon such libraries, as: flick_video_player and native flutter functions(video recording, image picking and audio recording). Back-end: using springboot and springweb we implemented a system of get and post requests, that can store user data, update the database, send videos and update the necessary information.

Challenges we ran into

This is our first Hackathon, so believe me when I say, that everything was a challenge! Even though we had experience from our university projects, none of us ever tried developing an app from the start. Every challenge was an absolute joy to overcome though! We had so many moments, where we almost gave on a feature, only to get it done in a few minutes. It brought us a ton of emotions.

Accomplishments that we're proud of

Well, for starters, developing a working application. Even though we believed in the idea, we didn't know if we could implement everything we want. But when we did, it was one of the most proud moment of our programming careers.

What we learned

The most important team we learned was working in a team and getting hands-on experience on delevoping an application, that features a lot of backend and AI work. This experience is absolutely crucial for our future projects and for improving Pandojo in upcoming updates.

What's next for Pandojo

We loved this idea too much for it to be a one-time thing, so we all agreed to develop it further. We have a roadmap of updates we need to implenet: from broadening the scope of our courses, to improving the ranked system!