+ 3

Please help. How to: Create my first bot to fetch counts of medical literature w/ python, r, or another data science lang

https://marcobonzanini.com/2015/01/12/searching-pubmed-with-python/ I want to know exhaustively how many unique books and articles exist on a particular topic and whether within the results how many use certain words. how would I begin to understand how to do something like this using python or a web scraping bot? I am familiar with urllib module in theory, but haven't really seen how it really practically works. curious what the community might have to say. yes, I have googled, it's just a lot to sift through and hope someone here could leave me a few bread crumb trails to the jackpot. thanks!

21st Jul 2018, 1:30 PM
Eliot Sanford
Eliot Sanford - avatar
4 Answers
+ 2
I normally use beautifulsoup for web scraping which is another python module like urllib but it is very popular and so has lots if tutorials and documentation and is easy to use https://www.crummy.com/software/BeautifulSoup/bs4/doc/
22nd Jul 2018, 10:54 AM
Dave David
Dave David - avatar
+ 2
yeah its free just install it in python using Pip
22nd Jul 2018, 10:57 AM
Dave David
Dave David - avatar
+ 2
cool, thanks! 🤔😊
22nd Jul 2018, 11:00 AM
Eliot Sanford
Eliot Sanford - avatar
+ 1
thanks! I'll check it out. I vaguely remember seeing that before. it's free right?
22nd Jul 2018, 10:56 AM
Eliot Sanford
Eliot Sanford - avatar