An unexpected hit by the Yandex Yandex filter - recapture lost positions (404 response code)!
Greetings to you, ladies and gentlemen!
Without a quarter five years ago, I created a project for Autotourist.Ru , dedicated, respectively, to automotive travel and automotive tourism. For almost 5 years, the resource has matured, it has become recognizable on the Internet and rightfully occupied leading positions in search engines for thematic search queries, such as “autotravel in Europe”, “caravanning”, “to Greece by car” and many others. Now I want to stay only on the Yandex substation - the main source of high-quality search traffic for Avtoturistu.Ru.
So, the screenshot below shows the growth dynamics of search traffic from Yandex over the past 2 years:
')
Actually, as can be seen from statistics, the traffic from Yandex grew dynamically and grows from year to year. Hooray! Some, as it turned out, illusory stability is present. But ... Yes, yes, illusory, because well, I did not think, I didn’t guess that a high-quality website that is 100% responsive to its subject matter and needs of visitors can be repressed and put under the Yandex filter! And, as follows from the title of this topic, under ADALT-FILTER, that is, classified as a site for adults. -) But I understood it not immediately. So what happened.
Onefine moment (about two weeks ago) I see such a "black square":
The copious hair on my head stirred in a frenzy: "What is it?" I am writing to the Yandex webmaster support service, saying what happened? Plato replied that the same “adult filter” was imposed on my resource due to the presence of “adult advertising” on the site. “Hmm, I think I am! Here are the times, here zhezh girls dance! ”. From an advertisement that is rotated on Avtoturistu.Ru I have:
- periodic advertising of direct advertisers;
- advertisements of the Yandex Advertising Network;
- advertising Google EdSens.
I also had traffic informers MarketGid, RedTram and Novostimira. Subjects of spin-off news in the informers: news, tourism, traffic rules, cooking. I think: "Surely because of teaser"? Removed them. Immediately remember one interesting fact. Some time ago, the site underwent a kind of XSS-attack, when the site was “flooded” with topics advertising intimate services (a la “putana.tsz”). With the “hole”, which allows massively using the script to fill in the database with this rubbish, they caught and fixed, the topics, respectively, rubbed, but! .. I remember that quite often as search queries that people came to at Autotourist.Ru, there were such as : "Individuals of St. Petersburg", "the best prostitutes of Krasnodar" and others. What? Yes tags! For each topic, a lot of spam tags were “born”, to which I simply did not pay enough attention. Tru tags through the database, again I write in the support of Yandex, saying "But isn't it, most likely, the reason for the imposition of an adult filter on the site?". The answer is about that: “No, not the content is the reason, but the advertisement”. Google until it's blue on the topic “what is the adult filter and how to get the site out of it”. I find a bunch of information that this filter is often superimposed because of the very YAN (!!!). That is, if you are a platform that unscrews the Yandex.Direct blocks and you haven’t set a setting in the site settings that prohibits unscrewing “advertising for adults” (here I was surprised that, by default, this setting was turned on, though in my opinion, it would be much more logical if, by default, it was turned off), then your site may fall under the appropriate filter due to its own advertising! I put a daw in the YAN, in EdSense, the teaser is turned off, the tags are 90% cleaned. One "an", two "an", three "an" ...
(Google dropped the traffic, most likely when it was played with closing pages with tags in robots.txt).
But there are some tags that take a good position in PS and as HF requests, and as LF, for example: " By car to Greece ". I think that closing all tags from indexing is not the best solution, because, indeed, you will lose part of the traffic for nothing. Opinions on the concept of “closing tags” or “not closing tags” from indexing, according to my research, differ. But, nevertheless, "prickly" and do not want to close everything. And here one person respected on the Russian market of SEO-services is a man, my friend, opens my eyes to the next; in view of the features of the site engine, tags that are physically cleaned from the database, however, are displayed in this way .
But the matter turned out to be simple: the response code of such a page was “200”, and not “404”. Accordingly, my site “pumped up” very well by intimate requests and, I even delete all the tags from the database, the PS still sees this page as being and indexes it. Today in the server settings changed the settings, the response code is 404. Temporarily closed all tags from indexing by the Yandex bot in robots.txt to speed up the re-indexing of the site content. Now I am waiting for the restoration of lost positions.
I hope that I did everything right (if not, it would be EXTREMELY happy about the comments, what other actions to take to normalize the situation with the issuance of Yandex), and that, perhaps, my negative experience may be useful to someone. Well, that is, I “ate” myself - I share with a friend-) Good for all the work week!
Without a quarter five years ago, I created a project for Autotourist.Ru , dedicated, respectively, to automotive travel and automotive tourism. For almost 5 years, the resource has matured, it has become recognizable on the Internet and rightfully occupied leading positions in search engines for thematic search queries, such as “autotravel in Europe”, “caravanning”, “to Greece by car” and many others. Now I want to stay only on the Yandex substation - the main source of high-quality search traffic for Avtoturistu.Ru.
So, the screenshot below shows the growth dynamics of search traffic from Yandex over the past 2 years:
')
Actually, as can be seen from statistics, the traffic from Yandex grew dynamically and grows from year to year. Hooray! Some, as it turned out, illusory stability is present. But ... Yes, yes, illusory, because well, I did not think, I didn’t guess that a high-quality website that is 100% responsive to its subject matter and needs of visitors can be repressed and put under the Yandex filter! And, as follows from the title of this topic, under ADALT-FILTER, that is, classified as a site for adults. -) But I understood it not immediately. So what happened.
One
The copious hair on my head stirred in a frenzy: "What is it?" I am writing to the Yandex webmaster support service, saying what happened? Plato replied that the same “adult filter” was imposed on my resource due to the presence of “adult advertising” on the site. “Hmm, I think I am! Here are the times, here zhezh girls dance! ”. From an advertisement that is rotated on Avtoturistu.Ru I have:
- periodic advertising of direct advertisers;
- advertisements of the Yandex Advertising Network;
- advertising Google EdSens.
I also had traffic informers MarketGid, RedTram and Novostimira. Subjects of spin-off news in the informers: news, tourism, traffic rules, cooking. I think: "Surely because of teaser"? Removed them. Immediately remember one interesting fact. Some time ago, the site underwent a kind of XSS-attack, when the site was “flooded” with topics advertising intimate services (a la “putana.tsz”). With the “hole”, which allows massively using the script to fill in the database with this rubbish, they caught and fixed, the topics, respectively, rubbed, but! .. I remember that quite often as search queries that people came to at Autotourist.Ru, there were such as : "Individuals of St. Petersburg", "the best prostitutes of Krasnodar" and others. What? Yes tags! For each topic, a lot of spam tags were “born”, to which I simply did not pay enough attention. Tru tags through the database, again I write in the support of Yandex, saying "But isn't it, most likely, the reason for the imposition of an adult filter on the site?". The answer is about that: “No, not the content is the reason, but the advertisement”. Google until it's blue on the topic “what is the adult filter and how to get the site out of it”. I find a bunch of information that this filter is often superimposed because of the very YAN (!!!). That is, if you are a platform that unscrews the Yandex.Direct blocks and you haven’t set a setting in the site settings that prohibits unscrewing “advertising for adults” (here I was surprised that, by default, this setting was turned on, though in my opinion, it would be much more logical if, by default, it was turned off), then your site may fall under the appropriate filter due to its own advertising! I put a daw in the YAN, in EdSense, the teaser is turned off, the tags are 90% cleaned. One "an", two "an", three "an" ...
(Google dropped the traffic, most likely when it was played with closing pages with tags in robots.txt).
But there are some tags that take a good position in PS and as HF requests, and as LF, for example: " By car to Greece ". I think that closing all tags from indexing is not the best solution, because, indeed, you will lose part of the traffic for nothing. Opinions on the concept of “closing tags” or “not closing tags” from indexing, according to my research, differ. But, nevertheless, "prickly" and do not want to close everything. And here one person respected on the Russian market of SEO-services is a man, my friend, opens my eyes to the next; in view of the features of the site engine, tags that are physically cleaned from the database, however, are displayed in this way .
But the matter turned out to be simple: the response code of such a page was “200”, and not “404”. Accordingly, my site “pumped up” very well by intimate requests and, I even delete all the tags from the database, the PS still sees this page as being and indexes it. Today in the server settings changed the settings, the response code is 404. Temporarily closed all tags from indexing by the Yandex bot in robots.txt to speed up the re-indexing of the site content. Now I am waiting for the restoration of lost positions.
I hope that I did everything right (if not, it would be EXTREMELY happy about the comments, what other actions to take to normalize the situation with the issuance of Yandex), and that, perhaps, my negative experience may be useful to someone. Well, that is, I “ate” myself - I share with a friend-) Good for all the work week!
Source: https://habr.com/ru/post/213673/
All Articles