Hand Gesture Game Controller

Hill Climb Racing
Subway Surfers
Nodes on hands
Multi Hand Recognition
Eye detection(Future Scope)

New and Fun Way to Control Games

What it does

Use Hand Gestures to control your Favourite Game instead of using the old boring keyboard to make your gaming experience more fun!! The gestures are recognized and the respective key is then pressed for that gesture till the time it is formed. Gesture for : Up arrow key - 1 finger open. Down arrow key - all fingers closed. Left arrow key - Left palm open RIght arrow key- RIght palm open.

How I built it

I built it using some of latest, cutting edge ,amazing libraries of Python like OpenCV, mediapipe and ctype. OpenCV - deals with video capturing, display, text display over video part. Mediapipe- deals with recognizing hand gestures. Ctype- uses scan codes for pressing the key according to a particular gesture.

Challenges I ran into

Doing all of this alone in a short span of time was little tough, using trial and error to know proper coordinates of the screen, choosing proper gestures to make it user-friendly was another challenge which i managed to overcome.

Accomplishments that we're proud of

Building a project for the very first time which has the potential to bring a revolution in the gaming industry made me very happy.

What I learned

I learned using OpenCV,mediapipe,ctype libraries and also became a bit better gamer. :-)

What's next for Hand Gesture Game Controller

Implementing eye recognition through which cursor can be controlled so that games which require 360 degree movement of cursor like 'Call of Duty' can be played using this tool.