Which is the best python library for web scrapping? | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson
+ 1

Which is the best python library for web scrapping?

One that is lightweight and has support for proxies and user-agent headers as well as proper cookie management

25th Jul 2020, 11:28 AM
George Onyango
5 Answers
+ 2
I have heard Selenium is good.
25th Jul 2020, 11:30 AM
Arsenic
Arsenic - avatar
+ 2
George Onyango The word "best" is debatable here. Each web scrapper has its own strengths and weaknesses.😃😃 Beautiful soup is good, so is Selenium.
25th Jul 2020, 11:35 AM
Tomiwa Joseph
Tomiwa Joseph - avatar
+ 2
Tomiwa Let's have best as one which easily supports anonymity and is lightweight.
25th Jul 2020, 11:40 AM
George Onyango
+ 2
Arsenic Thought Selenium needed a browser to work; I suppose it's heavy
25th Jul 2020, 11:42 AM
George Onyango
+ 1
I have Used Beautifull soup 4 (bs4). It is good to scrape web
26th Jul 2020, 4:43 AM
Kartikey Kumar
Kartikey Kumar - avatar