Mindgrasp

Inspiration

We are inspired by futuristic technologies such as how Tony Stark interacts with his projects using holograms. While true hologram technology is still far from perfect, we aim to replicate a similar experience using hand gesture recognition. Mindgrasp is designed as a tool to manage projects, support learning, and create a more natural way to interact with the digital world. Beyond productivity, we also realized that Mindgrasp has the potential to bridge digital interaction gaps for people with disabilities.

What It Does

Mindgrasp is a real-time web application that allows users to manipulate on-screen elements using hand movements captured through a camera. By translating physical gestures into digital actions, users can interact with applications in a more intuitive and immersive way.

How We Built It

Mindgrasp is built using MediaPipe and OpenCV for real-time hand gesture detection and tracking. These gestures are translated into interactive actions directly in the browser.
The backend is powered by Django, Django Channels, and Redis, enabling low-latency and asynchronous communication to ensure smooth and responsive gesture-based control.

Challenges We Ran Into

One of the major challenges we encountered was related to deployment and domain management. During the early development phase, we lost our initial domain due to third-party issues. However, our team adapted quickly, learned from the experience, and resolved the problem within hours.

Accomplishments That We're Proud Of

We successfully built a functional digital interaction tool that demonstrates how gesture-based interfaces can shape the future of how humans interact with digital devices.

What We Learned

Through this project, we learned how to collaborate effectively with people we had never worked with before. We gained valuable experience in communicating ideas and aligning visions so that every team member’s contribution mattered. Most importantly, we built strong connections and learned from one another throughout the process.

What's Next for Mindgrasp

In the future, Mindgrasp will support face recognition as an additional interaction method, enabling more inclusive access for users with disabilities. Our goal is not only to build profitable software, but also to create technology that genuinely helps people in need.

Built With

• digitalocean
• django
• mediapipe
• opencv
• redis
• typescript
• vercel