Scrapy- beautiful soup- selenium Which one is the best tools for web scraping in terms of functionality I want to start learning web scraping but I want to make sure I will chose the right tools P.N: I searched to find if this question was asked before but I didn't find any sorry if its a duplicate
9/20/2020 8:01:28 PMpedram ch
2 AnswersNew Answer
I like beatiful soup in python-here are some examples: https://code.sololearn.com/c80BReGK9i1L/?ref=app
selenium to get page source if dynamic page. bs is cool, but may not get the data always. I use ‘re’ mostly. the combo of all these are important, I think. I used to do web scraping when I began coding. Automation is handy.