Input to Virtual Personal Assistant by Gesture Using Machine Learning and Arduino

Conference: 3rd International Conference on Innovations in Electrical, Information and Communication Engineering
Author(s): B.Venkatesh, R. Ram Kumar, V.Sudharsan, E.Thirumurugan Year: 2021
Grenze ID: 02.ICIEICE.2021.1.15_1 Page: 80-83

Abstract

A hand gestures are used to give the input to the virtual assistant. By which the user\ncan operate a system only with the gestures. This project can also be used to listen voice of the\nuser to perform an action in the system. This project will help the user to do the simple input\ntasks by keyboard and mouse replaced by gestures. We done the simple gestures for the\npersonal computer to perform a frequently used processes screenshot, opening application that\nis used more frequently with the gestures and using the applications for user requirements.\nThese hand gesture using Arduino is used by many and all the projects were in the beginning\nstages only so we hope to have this project to reach more users and make this project as a huge\nsuccess. We not only making the gestures but also an AI virtual assistant. Last but not the least,\nIn this project we integrated two technology Arduino and Machine Learning to have high hopes\nand the success of this project lead to a greater leap of using the personal computer. In python\nspeech recognition is used to listen to the audio input and the training set that we already\nprepared will be verified and desired output will be provided. In Arduino, Microchip\nATmega328P microcontroller is used with 6 analog input pins. The ultrasonic sensor is attached\nto read the input from the user by the disturbance of the wave and the echo strength reaching\nback the sensor. We show how to operate simple operation in personal computer through\ngesture and voice command.

<< BACK

ICIEICE - 2021