How useful is scrapy? | Sololearn: Learn to code for FREE!


How useful is scrapy?

Python short description of the usefulness of the scrapy module in python

8/15/2017 4:21:22 PM


1 Answer

New Answer


Scrapy is a webcrawling framework. You can pretty easily get a webcrawler (webspider) running in it and set its parameters (rules of crawling, depth, sorts of websites, etc.) After that you can run your spiders from the command line (shell). Just prepare some hard drive space for them! ;)