3 AnswersNew Answer
for webscraping in python you have the following resources: requests (http requests) https://docs.python-requests.org/en/master/ beautifulsoup (read html) https://www.crummy.com/software/BeautifulSoup/bs4/doc/ scrapy (web crawling for many sites) https://docs.scrapy.org/en/latest/intro/tutorial.html selenium (mainly used for web automation) https://selenium-python.readthedocs.io you may have to download other dependancies and you can get those by reading their documentation. happy scraping. also a word of caution, some websites discourage any kind if scraping usually identified in their terms of service/agreement. also, please be curtious with the number of requests you make to a site. sending hundreds or thousands of requests within a short amount of time (seconds) puts a strain on their servers and could cause you to be restricted to have access to that aite in the future. other sites have limits if how many requests you can make in a period (sometimes hours or days).