Gamified Workout Reps

Inspiration

Recently, us CS majors haven't had much time to do much working out. So, to bring incentive and encourage ourselves, we've decided that we wanted to gamify our workouts and turn our reps into something much more: Actions within a game. We believe that everyone in the world should encourage themselves to workout and keep their bodies healthy.

What it does

Each time you do a rep of a workout, such as a pushup or a sit-up, an action within a game will be triggered. For example, your character in a game may jump each time you do one pushup.

How we built it

We used Google's Mediapipe API alongside some mathematical techniques to track points on a person's body through their webcam, as well as count their reps based on how the points change. The API was implemented through Typescript into a NextJS frontend framework.

Challenges we ran into

The Mediapipe pose tracking was difficult to train, but we did the best we could. Also, the calculations required for counting rep affected the quality of the games heavily, but we believe that this problem can be solved if better optimization or a better computer was used.

Accomplishments that we're proud of

To be honest, we are proud that we even deployed a working final demo, but I think we are most proud of the integration and detection of reps using Mediapipe.

What we learned

We learned to plan ahead properly as well as create a proper timelines for future hackathons. We also learned which elements of our full-stack development skills still required more polishing and work. It was a great learning experience that pushed us to our limits.

What's next for Gamified Workout Reps

Honestly, we hope to create a more accurate and optimized pose tracker, so that others can use this accessible method of tracking for their own workout apps.