ReviewScraper

Scrape the product reviews and store them in a database.

Table of Contents

• General Info
• Features
• Screenshots
• Setup
• Usage
• Room for Improvement
• Contact
• License

General Information

• This project scrapes the reviews of the products from Flipkart and stores them in a database to avoid scraping for the same product at a later point in time.

Features

• Provides user interface
• Interactive graphical representation of ratings

Screenshots

Setup

Clone this repo using

git clone https://github.com/Anil-45/ReviewScraper.git

Install the required modules using

pip install -r Requirements.txt

Usage

To use SQL database, generate a config file using generate_config.py.

Open generate_config.py and edit host, username and password.

config_file.set(DATABASE, HOST, "127.0.0.1")
config_file.set(DATABASE, USERNAME, "root")
config_file.set(DATABASE, PASSWORD, "root")

Once you are done editing, run:

python generate_config.py

Alternatively, you can also edit config.ini.

You can run the project without a database also, but the results for the products will always be scraped.

Run the app:

python app.py

Open http://127.0.0.1:5000/

You can find all the logs in .log files

Room for Improvement

• Add support for different databases.

Contact

Created by @Anil_Reddy

License

This project is available under the MIT.