+ 3

How useful is scrapy?

Python short description of the usefulness of the scrapy module in python

15th Aug 2017, 4:21 PM
Given
Given - avatar
1 Answer
+ 7
Scrapy is a webcrawling framework. You can pretty easily get a webcrawler (webspider) running in it and set its parameters (rules of crawling, depth, sorts of websites, etc.) After that you can run your spiders from the command line (shell). Just prepare some hard drive space for them! ;)
15th Aug 2017, 4:59 PM
Kuba Siekierzyński
Kuba Siekierzyński - avatar