Scraping Domain Registrations | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson
0

Scraping Domain Registrations

I am currently scraping newly registered domains with Python, using API from zonefiles.io (zones aggregator) Is there a more direct way to scrape this.Does ICANN provide access to this type of data? Would be grateful if anyone knows a good direction.

17th Nov 2020, 6:34 AM
terramit
3 Answers
0
Nah, you gotta start like everyone else. Make a spider, and have it crawl. There are sites that google doesn't know about and they have spiders crawling 24/7 and follow robots.txt!
17th Nov 2020, 7:55 AM
Slick
Slick - avatar
0
Thanks Slick. Just realised ICANN's Centralised Zone Data Service (CZDS) works for gTLDs which gets updated daily. However, for ccTLDs, i have not been able to find a solution yet barring crawling which is not really an option.
17th Nov 2020, 3:32 PM
terramit
0
Anyone if you worked out a solution for ccTLDs, i'm all ears. Thanks in advance guys.
17th Nov 2020, 3:33 PM
terramit