Audio and Vision based Indian Sign Language Translator

There is a need for a real-time two-way communication system to help deaf people communicate with non-disabled individuals by converting Indian sign language to spoken English speech and vice versa. Although various technological advancements have been made over the years to help the deaf community communicate with others, they have failed due to their complexity and limited sign language datasets. The proposed system is a portable hardware device consisting of input and output components, including a camera, microphone, speaker, and LCD screen, connected to a Raspberry Pi. The system uses machine learning and python libraries to convert the deaf individual's gestures into speech for non-disabled individuals and vice versa. The model is trained with a custom dataset to be compatible with Indian sign language