Web scraping | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson
+ 2

Web scraping

Somebody help me to do web scraping of live data for unlimited data of this website http://www.nepalstock.com

25th Jun 2021, 6:37 PM
Susan Maharjan
3 Answers
+ 1
Thank you!
27th Jun 2021, 7:23 PM
Susan Maharjan
+ 3
for webscraping in python you have the following resources: requests (http requests) https://docs.python-requests.org/en/master/ beautifulsoup (read html) https://www.crummy.com/software/BeautifulSoup/bs4/doc/ scrapy (web crawling for many sites) https://docs.scrapy.org/en/latest/intro/tutorial.html selenium (mainly used for web automation) https://selenium-python.readthedocs.io you may have to download other dependancies and you can get those by reading their documentation. happy scraping. also a word of caution, some websites discourage any kind if scraping usually identified in their terms of service/agreement. also, please be curtious with the number of requests you make to a site. sending hundreds or thousands of requests within a short amount of time (seconds) puts a strain on their servers and could cause you to be restricted to have access to that aite in the future. other sites have limits if how many requests you can make in a period (sometimes hours or days).
25th Jun 2021, 9:25 PM
you are smart. you are brave.
you are smart. you are brave. - avatar
0
you’re welcome.
27th Jun 2021, 8:20 PM
you are smart. you are brave.
you are smart. you are brave. - avatar