VisionMate: A Comprehensive Mobile Assistive Application for Visually Impaired Individuals

This paper presents VisionMate, a comprehensive mobile assistive application developed to support visually impaired individuals in performing everyday tasks independently. The primary objective of this work is to develop a unified, accessible solution that addresses the fragmentation and limitations of existing assistive tools. The application combines a wide array of accessibility focused features powered by the Gemini API, which serves as the core engine behind real-time image recognition, voice-enabled personal Chatbot interaction, multilingual text-to-speech (TTS), currency recognition, and smart navigation assistance. The image recognition module enables users to capture photos of their surroundings and receive meaningful voice responses based on spoken prompts. The Chatbot provides conversational support and assistance for personalized queries. The TTS module not only extracts text from images but also detects the language and delivers both the full content and a summarized version through speech. Currency recognition supports multiple international currencies, enhancing financial independence for users’ globally. The application also offers live content magnification, allowing users with partial vision to enlarge camera feed visuals in real time according to their preferred text size. An SOS module facilitates emergency communication by sending messages and current location links via SMS and WhatsApp. For mobility assistance, the application utilizes Gemini to generate navigation URLs based on source and destination in walking mode, which are then opened directly in Google Maps for guided navigation. Additionally, the system provides contextual awareness by identifying the user’s nearby address, notable landmarks, and current weather conditions. The prototype demonstrates the feasibility of integrating multiple assistive features into a single mobile platform and shows promising functionality during internal validation. With its voice guided interface, large onscreen buttons and multi feature integration, VisionMate demonstrates the potential of mobile AI to deliver inclusive, real-time support for the visually impaired.