Real-Time Sign Language Recognition in Video Conferencing with DTW and MediaPipe

In today's world, where video conferencing is a rudimentary aspect of global communication, a significant gap persists for individuals who rely on sign language for their means of interaction with the world. With the advent of Covid-19, a dire need for remote communication emerged which led to the prominence of many video conferencing solutions. Although they were successful in appealing to the masses, they failed to cater to the needs of specially abled communities, thus limiting their full participation in virtual interactions. By leveraging Dynamic Time Warping (DTW) algorithm, our solution accurately translates hand movements into text and speech. DTW enables precise matching of temporal sequences, allowing for real-time recognition of sign language gestures, even when there are variations in speed and style. This innovation empowers individuals with disabilities to express themselves more easily and addresses the gap by developing an advanced video conferencing tool that translates sign language gestures with high accuracy.