Speak-Sure Interview Assistant: Application of Speech and Gesture Recognition

Communication has always been a crucial part of everyday life and is fundamental to profes-sional success. In recent years, it has become a key indicator of a person's achievements in pro-fessional settings and is often considered an essential skill for any potential candidate in an or-ganization. Recognizing this trend, this paper aims to develop interview assistant software by in-tegrating speech and gesture recognition technologies, focusing on both verbal and non-verbal aspects of communication. A website is developed using programming languages and frame-works to accurately capture and detect the user's speech and gestures. The proposed software employs API endpoints for speech recognition and utilizes TensorFlow, an open-source machine learning framework, for gesture recognition. TensorFlow is trained using datasets created with Teachable Machine, a web-based tool.