A Speech Controlled Visual Storytelling App-Assistant for E-learning

Journal: GRENZE International Journal of Engineering and Technology
Authors: N.S. Shirsat, Vaishnavi Vishnu Jagdale, Rajkumar Madhav Pawar, Prerana Chandrakant Jadhav, Shivang Jalandhar Gupta
Volume: 10 Issue: 2
Grenze ID: 01.GIJET.10.2.608_1 Pages: 1593-1599

Abstract

E-learning refers to the use of electronic technologies to deliver educational content and facilitate learning outside of traditional classroom settings. E-learning offers flexibility in terms of time, location, and pace of learning, making it accessible to a diverse range of learners. The main problem identified with these tools is the limited engagement and accessibility for children and very less interaction between students and teachers as well as kids and parents. Traditional E-learning tools are lacking interactive elements that promote active engagement and participation from learners. This article exhibits a comprehensive system where users can provide speech input to the system, which then retrieves relevant images from a dataset based on natural language processing (NLP).The use of NLP ensures that the flow of the story is maintained seamlessly, as the system intelligently positions images at appropriate points in the narrative. Leveraging computer vision technology, individual images stored in the dataset are accurately placed within the context of the story, enhancing interactivity and engagement. By combining speech recognition, NLP, and computer vision for image positioning, this solution offers a more interactive and immersive learning experience, particularly in the context of narrative-driven content like Panchatantra stories.

Download Now << BACK

GIJET