Inspiration
Coach.me was born from a mission to make fitness training inclusive for all, leveraging AI and computer vision. Our aim is to bring personalized exercise feedback to everyone, fostering a friendly and accessible approach to fitness, while also helping users refine their form to prevent injuries.
What it does
Coach.me offers a variety of exercises and provides real-time feedback on form accuracy. Users receive instant notifications when performing exercises correctly and can ask questions for immediate feedback, enhancing their learning and safety during workouts.
How we built it
Coach.me was built using a combination of technologies to provide a seamless user experience. The UI was developed using the PyQt Python library, ensuring an intuitive interface for users. For the critical task of form detection, we employed MediaPipe and OpenCV for computer vision capabilities, enabling accurate real-time analysis of exercise form. Additionally, we integrated Whisper for speech-to-text functionality, ChatGPT for AI prompting, and OpenAI TTS for text-to-speech capabilities, enhancing the interactive experience and accessibility of the app.
Challenges we ran into
During development, we encountered hurdles installing required libraries on our Coach.me tablet running Ubuntu on an ARM architecture. We also worked to seamlessly integrate various technologies, ensuring effective feedback delivery. Through collaboration and innovation, we overcame these obstacles, enhancing the app's functionality.
Accomplishments that we're proud of
We had a blast when our pose detection algorithms nailed recognizing exercise forms, and we couldn't resist trying them out ourselves! Plus, we're stoked about seamlessly blending all those cool tech tools together to make a smooth user experience. These wins really showcase our team's knack for making fitness training fun and accessible.
What we learned
Working on Coach.me, we realized that crafting UIs with Python, especially using PyQt, can be quite tricky. Plus, we got a crash course in exercise anatomy, learning all about those nitty-gritty joint angles. These experiences really leveled up our skills and gave us some great stories to share!
What's next for Coach.me
We're eager to expand Coach.me's functionality by adding more exercises and catering to a broader range of fitness enthusiasts. Imagining Coach.me integrated into actual gyms is an exciting prospect, offering users access to real-time feedback and guidance during their workouts. Additionally, we're aiming to implement full workout detection capabilities, enabling Coach.me to track and log users' performance for valuable insights and progress tracking. These future developments will further enhance Coach.me's utility and effectiveness in helping users achieve their fitness goals.
Log in or sign up for Devpost to join the conversation.