Why close the indexing of the content project?
Gentlemen, can anyone explain why they should completely block the content project from being indexed? Found an example of this on Drive.ru :
User-agent : *
Disallow: /
Unless for some reason they want to first accumulate content, and then arrange for themselves a “rocket take-off”, having driven everything into index at once.
Disallow: /
Unless for some reason they want to first accumulate content, and then arrange for themselves a “rocket take-off”, having driven everything into index at once.
')
Source: https://habr.com/ru/post/175/
All Articles