Gesture Recognition based Virtual Mouse and Keyboard

Today computer vision is extensively used in our daily lives, right from a simple program for identifying a device’s owner using image processing to face detection, colour recognition, car automation etc. it has reached an epitome. Computers are been evolving since their inception and now can be operated remotely, wireless. People having physical disorder are in need of an alternative approach to make the computers user friendly for them. To overcome this issue, in this project we have developed a system where we will be using computer vision to create a virtual mouse and keyboard using eyeballs and hand gestures. The camera mounted will capture different gestures of a human’s hand and accordingly execute different functionalities like using unary finger gesture for selecting an alphabet and similarly detecting eyeball movement to move the cursor of the computer accordingly. It will act similar to physical keyboard and mouse just the difference that no external wires or devices will be used. The only hardware requirement will be a web-cam and coding is done using python. Thus, this system is not only cost-efficient but also comes offers free pre-installation requirements and is helpful for differently abled people.