When comparing Scrapy vs Web Scraper (Chrome App), the Slant community recommends Scrapy for most people. In the question“What are the best web crawlers/spiders?” Scrapy is ranked 1st while Web Scraper (Chrome App) is ranked 6th. The most important reason people chose Scrapy is:
While a lot of the other tools e.g. BeautifulSoup involve stringing together multiple libraries and custom code to get the job done, Scrapy is very convention-oriented (generates skeleton files and projects for you) and has built-in solutions or plugins for most tasks e.g. IP rotation, pagination, multi-step processing/filtering.
Specs
Ranked in these QuestionsQuestion Ranking
Pros
Pro Comprehensive framework
While a lot of the other tools e.g. BeautifulSoup involve stringing together multiple libraries and custom code to get the job done, Scrapy is very convention-oriented (generates skeleton files and projects for you) and has built-in solutions or plugins for most tasks e.g. IP rotation, pagination, multi-step processing/filtering.
Pro Fully support dynamic content
Even one page websites can be scraped as it run in a real fully fetched browser.
Pro Easy to install and use
It's a Chrome App so if you've Chrome, it's one click to start using it on any platform.
Cons
Con Not so easy to use
The interface isn't that intuitive especially if you want to follow links.
Con Cannot perform complex operations
Has a basic UI but you cannot script it really to customize certain aspects.