This is an application of scraping indian movie celebrities using Scrapy.I scrapped the data from imdb, wikipedia and ranker and stored in mongo db.
To execute the code install the modules from requirements.txt and run the commands below to get information from corresponding websites:
- scrapy crawl imdb_scrap
- scrapy crawl wiki
- scrapy crawl ranker_scrap