+ 3
Why people use meta tag name = robot ? Robot.text file on website for not show website on Google search no beifite why? Use?
please explain I want answer from a good website devloper
7 ответов
+ 6
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robotabout which areas of the website should not be processed or scanned
+ 5
Suppose you have an website and you wanted to be safe from hackers so you have hide to your Admin page so in that situation you can use Robot.txt .
+ 4
They prevent some credentials to be listed in search.
+ 4
They don't do any experiment !
+ 2
why they hide information what they do on webpage (devloper) it?
+ 2
no what type of experiment they do
+ 1
wow