Is web scrapping a part of web development field or should I call it a different field altogether? | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson
+ 2

Is web scrapping a part of web development field or should I call it a different field altogether?

22nd Apr 2018, 6:00 PM
Koushik Naskar
Koushik Naskar - avatar
6 Answers
+ 8
You usually use webscraping techniques to acquire some data, otherwise (hardly, tediously) unattainable. As Xan mentioned, that places this discipline somewhere in the data science field -- and is carried on to spiders/webcrawlers/harvesters and parsers/refining algorithms.
22nd Apr 2018, 7:16 PM
Kuba Siekierzyński
Kuba Siekierzyński - avatar
+ 4
We, general, often utilize various bits and pieces of codes from different places such as libs, github, stackoverflow, codepen, w3schools, and so on to get what we need - we call these resources. This is still a form of scrapping ~ However, there are those whom steal the whole website source code...
22nd Apr 2018, 7:31 PM
BroFar
BroFar - avatar
+ 3
I think no because web scrapping is just the technique or action of copying content from other resources (for example, content from other website) into our own resources or storage. Meanwhile, web development is the work done to develop the website altogether, including the process in between.
22nd Apr 2018, 6:09 PM
Azwan Abdullah
Azwan Abdullah - avatar
+ 3
website development architect ~
22nd Apr 2018, 7:52 PM
BroFar
BroFar - avatar
+ 1
I agree with Azwan. Web development is short for website development, in web scraping you aren't developing a website. It's more data science if anything (when done on a large scale).
22nd Apr 2018, 7:11 PM
Emma
0
So if you want to mention your skill what would you say...? Do you mention both?
22nd Apr 2018, 7:48 PM
Koushik Naskar
Koushik Naskar - avatar