Fit Game

Inspiration

Lockdown made us so lazy and cozy that we literally got affected with obesity and became fatty. PC and Mobile games motivate this behavior and make us sit in the same place for hours without any movements which makes us fatigue. So, we wanted to make a squid game themed game which helps us to play PC/Mobile games without making you become fatigue.

What it does

Fit game is an online gaming platform where you can play games using your body movements. Your body movements will be converted into suitable key presses, which in turn helps you play the game. We have also made it multiplayer compatible, so that you can create a room, and your friends can join your room using the room code. Points will be granted based on the movements you make until getting disqualified from the game. The player with the most points will be declared as a winner. This game will ~~make~~ force people to do physical exercises by playing their favorite games.

How we built it

Front end was done using React and Kivy.
Back end was done with Python.
Video sharing was done using Twilio Video Group Room.
Pose detection was done using OpenCV and Mediapipe. We ported the cefbrowser on top of kivy to make automation possible inside iframes without ticking off several browser policies.

Challenges we ran into

We first tried doing it as a web app that runs on a browser, but due to some browser security policies, we couldn't get our expected output. So we switched to Python.

Same origin policy was the worst thing that happened which forced us to make our own chromium browser with python bindings attached
Accuracy and latency needed a lot of tuning.

Reducing the latency between body movement and game input was a bit hard and time consuming. We had to manually tweak a lot of parameters to make it work well.

Accomplishments that we're proud of

We got struck a hell lot of times and we overcame it and was able to complete on time.

We were also able to maintain a good rhythm between the team mates so that we were able to split tasks accordingly and help out each other when needed.

What we learned

All of us were using Kivi for the first time, but still we were able to configure it properly and achieved the desired output.

Fit game also tracks body movements pretty well and we have spent a lot of time tweaking it.

What's next for Fit Game

Adding support for more games in the future. Making a global leaderboard so that the players can compete with each other online. Deploying it in a production environment.