How not to get into the issuance of Yandex
So that you don’t discuss how Yandex has indexed the private pages of your site, there’s a simple solution to display the meta tag on such pages:
It is convenient to add it to the base page template of the private part of the site.
And even if for some reason the search engine did not read robots.txt (or it didn’t have the necessary indexation ban) and still received the HTML of the private page, this tag will prohibit indexing.
Methods to control the behavior of Yandex-robot
Google also analyzes this meta tag.
<meta name="robots" content="noindex"/>
It is convenient to add it to the base page template of the private part of the site.
And even if for some reason the search engine did not read robots.txt (or it didn’t have the necessary indexation ban) and still received the HTML of the private page, this tag will prohibit indexing.
Methods to control the behavior of Yandex-robot
Google also analyzes this meta tag.
')
Source: https://habr.com/ru/post/124984/
All Articles