Web scraping and JavaScript | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson
+ 4

Web scraping and JavaScript

I have a code in Python that scrapes a web, but on the web what happens is that the javascript is executed to see the page, how can I execute that javascript to see the content of the page, (It is completely necessary to execute the javascript of the page) https://code.sololearn.com/cpp1W4o5CV12/?ref=app

11th Feb 2023, 5:02 PM
NinjaGamer
NinjaGamer - avatar
6 Answers
+ 2
Basil , Pavel But it can be done right here, SoloLearn?
11th Feb 2023, 9:02 PM
NinjaGamer
NinjaGamer - avatar
+ 2
you can also try selenium
13th Feb 2023, 3:59 PM
Toni Isotalo
Toni Isotalo - avatar
+ 1
You need another library - Pyppeteer or Playwright.
11th Feb 2023, 6:41 PM
Pavel
Pavel - avatar
+ 1
Hii friends, can you help me making a program. How to i start make a program. Do you know please reply me and tell solution
12th Feb 2023, 2:00 PM
RoyalsAryan Muskan
RoyalsAryan Muskan - avatar
+ 1
Hi friends, I should have written more precisely. I'm not guessing, I've been using the Playwright library with success. Yes, it's heavy because it contains a real browser engine. There is no other way. Once again, it is available in Python. You can find the official website with examples.
12th Feb 2023, 2:40 PM
Pavel
Pavel - avatar
+ 1
I've been waiting for this. No, please don't start a new project with Selenium. It's a tired dinosaur, it's time for him to rest ;)
13th Feb 2023, 5:20 PM
Pavel
Pavel - avatar