Web scrapping | Sololearn: Learn to code for FREE!


Web scrapping

Scrapy- beautiful soup- selenium Which one is the best tools for web scraping in terms of functionality I want to start learning web scraping but I want to make sure I will chose the right tools P.N: I searched to find if this question was asked before but I didn't find any sorry if its a duplicate

9/20/2020 8:01:28 PM

pedram ch

2 Answers

New Answer


I like beatiful soup in python-here are some examples: https://code.sololearn.com/c80BReGK9i1L/?ref=app


selenium to get page source if dynamic page. bs is cool, but may not get the data always. I use ‘re’ mostly. the combo of all these are important, I think. I used to do web scraping when I began coding. Automation is handy.