Web scrapping | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson
0

Web scrapping

Scrapy- beautiful soup- selenium Which one is the best tools for web scraping in terms of functionality I want to start learning web scraping but I want to make sure I will chose the right tools P.N: I searched to find if this question was asked before but I didn't find any sorry if its a duplicate

20th Sep 2020, 8:01 PM
pedram ch
pedram ch - avatar
2 Answers
+ 6
I like beatiful soup in python-here are some examples: https://code.sololearn.com/c80BReGK9i1L/?ref=app
20th Sep 2020, 11:21 PM
Galaxy-Coding (inactive)
Galaxy-Coding (inactive) - avatar
+ 1
selenium to get page source if dynamic page. bs is cool, but may not get the data always. I use ‘re’ mostly. the combo of all these are important, I think. I used to do web scraping when I began coding. Automation is handy.
20th Sep 2020, 9:57 PM
Flash