A Web Scraping-based Framework for Dynamic ECommerce Price Comparison using Flask, Selenium and BeautifulSoup

This paper presents a robust framework for dynamic e-commerce price comparison leveraging web scraping techniques. The framework utilizes Flask, Selenium, and BeautifulSoup to automate the extraction of product data from multiple e-commerce platforms such as Flipkart and Amazon. By dynamically generating search URLs and employing automated content extraction, the framework retrieves and compares product prices, descriptions, and images. Error handling mechanisms mitigate challenges like network disruptions and changes in webpage structures, ensuring reliable data extraction. Integrated into a Flask web application, the system offers users an intuitive interface for querying products and viewing comparative results. The effectiveness of the framework is demonstrated through case studies and performance evaluations under varying data volumes and user loads. Future enhancements include scalability improvements and expanding scraping capabilities across diverse e-commerce domains.