Gesture and Voice Controlled Virtual Mouse

The evolution of Human-Computer Interaction (HCI) has shifted toward touchless and intuitive interfaces, particularly in environments requiring hygiene, accessibility, and immersive interaction. This paper presents a Gesture and Voice Controlled Virtual Mouse, a multimodal system that enables users to operate computer functions through hand gestures and voice commands without physical contact. The proposed system is implemented using a standard webcam and microphone with Pythonbased open-source libraries such as OpenCV, MediaPipe, SpeechRecognition, and PyAutoGUI. The system supports cursor control, clicking actions, scrolling, window management, and system-level commands. Experimental evaluation involving multiple participants demonstrated a gesture recognition accuracy of 92% and voice command accuracy of 89%, with an average response latency of 0.18 seconds. The solution is cost-effective, requires no specialized hardware, and can be deployed on consumer-grade devices. The proposed framework contributes to next-generation touchless interfaces suitable for education, healthcare, assistive technologies, and smart environments.