EyeScreen

Inspiration

After finding difficulties in our workflow from the school terms, we decided to find a way to help improve the way we work and study. EyeScreens main objective is to aid users with improving their workflows regardless of their tasks. The key way of interacting with laptops and computers is through our finger tips, making it important not to disrupt the flow from our hands. Having to stop typing or letting go of a mouse is always frustrating, especially when certain devices or keyboards are missing features like prtsc. This is why EyeScreen uses the user's eyes, and since blinking is part of a natural reflex, EyeScreen can only be purposefully activated through fast double and triple blinks. This avoids major accidental activations, which is vital in maintaining a users workflow. Instead of dividing your attention and focus, EyeScreen runs silently in the background, out of sight.

What it does

Enter eyeScreen, the seamless utility app that helps you improve your workflow. EyeScreen lends a third hand when both your hands are busy, using computer vision to automatically execute pre-set shortcuts.
EyeScreen at its core detects and tracks the user’s blinks to determine when and which function to run. There are currently two features, a double blink, and a triple blink, built in with the two revisions of EyeScreen.

How we built it

EyeScreen was built using python 3.9.5, along with the opencv, dlib, and pyqt5 libraries.

Challenges we ran into

Combining the GUI drop down menu with our detection logic had some difficulties, and due to time limits, was not finished.

Accomplishments that we're proud of

Integrating the opencv functions along with detecting double and triple blink logic was one of our accomplishments for this project.

What we learned

The blink detection logic was new to us, and we learnt a lot about opencv as well. We also learnt a great deal with the PyQt5 library, even though we didnt finish its integration with our project.