Python - Data collection from a website.

Question

Hello everyone,

I'm new to Python and this app. I'm trying to find out if there's a way to have Python:
1) take a set Google search term
2) go into each result website
3) copy and paste certain information, such as: email addresses, phone numbers, and other such information
4. Paste the result in a document (preferable Excel)

Does anyone know if this is possible with Python, and if so, what topics I need to study to create a code for this?

Thank you,
Adrian

Answer 1

It's possible. You're searching for "web scraping". Python has a webbrowser module with which you can access websites, read their source codes, download text and even files. You can parse the soure code with the BeautifulSoup module. I don't know if you can paste anything into Excel files though.

Answer 2

Thank you very much Chris!

I'll start looking into this. I'm still new to Python and downloaded it with Anaconda. Will I need to download anything to use the BeautifulSoup module or just "import BeautifulSoup"?

Thank you so much again!