Exercise Gamified

Blend of Gaming And Exercise

Comment

Inspiration

Due to the lockdown scenario, we are seeing a great decline in physical activities among people all around the world. Most of us spend time laying on the sofa watching series and playing games. This is making us unhealthy and even when we are supposed to exercise we don't get enough motivation. So what if we are somehow able to enjoy exercise? This is exactly the project it is all about. In this project, we have made an application that would make exercise really interesting and this will be achieved by gamifying the exercise, that is the user can play certain computer games using his body gesture

What it does

In this project we have made a script using which users can control the games using gestures. In other words we can say that instead of gaming (and becoming unhealthy) we can use it to burn some calories.

  1. In Bicep Exercise we are using a car game that can is to be moved left or right and it will be done by using hands. When user moves left hand towards shoulder the car will move to left and vice versa. User can use resistance band as shown in video or also use dumbells
  2. In squats, the paddle of the ping pong game is moved according to the angle made by the user between knee and the hip. Basic trigonometry is used i.e. theta angle = cos inv (adj/hyp)
  3. In the last exercise that is bending torso sideways we have used space invaders game and when user has to shoot the planes they should be in upright position and for left and right they need to move to that specific direction. Games are downloaded from internet controlling is handled by our program

How we built it

We are using Python Programming Language as the primary programming language in this project In that we will be using Open CV library which is open source framework to perform various operations on images and also used vastly in Data Science and ML sector In this project we are using Mediapipe Library by google which works with help of OpenCV to detect pose of the user and give output of multiple landmarks on the body This very principle is being used in this project and based on distance between two points for eg. distance between hand and shoulder we can perform any operation. First user will be presented with a screen to select particular game, this is made using tkinter. Then user can select a game. Both screen (pose detection and gaming) will be shown to user. Just like any other game user will start playing it. Now instead of keyboard user has to use his gestures to play the game. The program will detect the motions of the user can using pyautogui the keyboard and mouse buttons will be clicked virtually Thus user can enjoy the game and exercise too image

Challenges we ran into

We were planning to develop a multiplayer web platform using react but we had few issues. We need to learn more on how socket works.

Accomplishments that we're proud of

We were successfully able to complete whatever we planned and also controls are working seamlessly

What we learned

We learned Mediapipe, OpenCV and Python also learned how to implement basic trigo formulas in real life

What's next for Exercise Gamified

We are planning to make multiplayer challenge like contest that people can play worldwide for eg. how many push ups in a minute. Also planning to make google extension that can be used to control games on site like miniclip and no need to use download games made using pygame (removing python barrier for selection of game)

Built With

Share this project:

Updates