Web Scraping with Python: Scrapy, Selenium or Beautiful Soup?

I am currently on the Machine Learning and Data Science module and one of the ways to get your data for analysis is to scrape websites for data. Which of these three would you advise I use for the Scraping exercise?

27th Dec 2020, 7:31 AM
BUSARI Ridwan  - avatar
3 Answers
+ 1
For Browser Automation: Use Selenium; For API Requests Use: Requests and Beautiful Soup; For Device Automation (eg. auto-opening an app) Use: Pyautogui;
1st Aug 2021, 11:09 AM
Sancho Godinho
Sancho Godinho - avatar
bs4, idk bout scrapy, and selenium is a programmable browser
27th Dec 2020, 7:35 AM
Slick - avatar
Use selenium
27th Dec 2020, 9:22 AM
Akash Agrawal
Akash Agrawal - avatar