Who and why is “spying” on Yandex?

We continue to reveal the secrets of the secret search engines cuisine. Today, we will look through the looking glass for how the information about new updates is “leaked” - in particular, for example, we’ll reveal the cards and honestly admit where we were the first to know that a rotation had appeared in the issue of Yandex.


Any search engine conducts updates issuing, search algorithm and other aspects. One thing unites them all: updates try not to reveal and even, if possible, not to advertise just so that all sorts of black SEO do not sharpen their methods for the new algorithm. For a simple user, this is not very noticeable - an invisible struggle, as a rule, is conducted according to the so-called “commercial inquiries” - for example, “plastic windows” - will you often type this in a search? One, two times in my life - you will hardly notice that something has changed. Unless sometimes it is impossible to find a site that was previously easily searched for and was “at hand” - this is the only way to notice that, most likely, this was another “update”.
')
All that is known about the updates of a wide audience - this is a certain estimated frequency. For example, updating the search results of Yandex is made on average once every 6 days. Guess yourself who is waiting for this every time with trepidation and why.

At this time, the “looking-glass” of the Internet industry “mirrored” an interesting picture: during the last two updates, on June 12 and 21, a number of sites disappeared from the issue by commercial inquiries and the young new generation took their place. Good riddance, not very sorry - you think. However, we are talking here about information leakage, the analysis of which made it possible to conclude that Yandex included a site rotation system in the new algorithm - and this will soon become a well-known sensation (in narrow circles).

How is the "leak"?

Information rules the world. A search engine is a Klondike of information about users and sites. Therefore, who has this information, that and Yandex (or Google). However, the collection of this information is not prohibited by law, so there are tools that scan the search engine for changes. In some ways, this looks like stock and currency quotes - an equally interesting “landscape” is obtained. Search engines are “closing down” from such initiatives, for example, forcing you to enter a captcha (did anyone notice?) - but this is a sure sign that a seoshnik started somewhere near you. Well, or that the company has one IP and a couple dozen of employees left something to google).

However, for every tricky labyrinth there is a new way with a screw: the so-called SERP trackers, collecting information about the rating of sites for issuing requests, use captcha bypass means, often very effective, because they use the cheap labor of hired droids and Karebelizia and Krablyanyan (according to numerous requests of schoolchildren from these countries, their names have been changed).

It works like this:



Creating such a database of queries over time is not a cheap pleasure: even despite the low cost of solving a captcha. In the case of a large number of large projects, only the collection of information of this kind can result in a monthly budget of 9-12 thousand rubles.

There are not so many large systems, but since we have access to the colossal base of MegaIndex, it was with the help of it that we managed to conduct fairly simple and accurate observations (remember, information rules the world?). Let us consider an example with a change in the issuance at the request of "plastic windows" in the Moscow region for June 21 and 12. This is what the system produces:



A full analysis can be viewed with MegaIndex here , however, so that you do not have to peer into small letters for a long time, we have already made a comparison and noticed:

1. Sites that were on the first positions, remained in their places
2. Some of the sites that were in the middle of the first hundred, have risen markedly. This happened as a result of falling out of the TOP100 sites in front of them.
3. Sites that were below a certain position (on average, below the 40th place), fell out of the TOP100. New projects appeared in their places.

Thus, the update of the algorithm, which has made such a large-scale change, obviously contains “something else”. This "something" is the introduction of rotation sites in the issue .

If you want to make sure of what is happening, here are some more statistics on the requests " freight traffic " and " tours ".

What is the site rotation in the issue?

In fact, a harmless innovation, giving a chance to sites that users have never found before - to appear in the search. It would seem, what does the word "behavioral"? And despite the fact that since this is a kind of “trend of the year”, it is quite possible to assume that such a step will provide an opportunity to show the user sites that are not potentially “linked” with links and keys and allow the user to wander through this site and find out the extent of his (user) activity on it. Based on this, the site can either be left in the issuance, or again "throw out" it and try on, trying to remove from the issue sites, which one of the MOZ speakers speaks of:

Dear websites, which look so rotten, but promise a lot in words - that's who you are:

Thus, there is a chance that, thanks to this rotation, the "filthy" sites will disappear somewhere, and more decent will take their place - this is the likely essence of the changes.

Although Yandex does not advertise what it is doing this summer, however, analytics of data about the current situation can provide first-hand information about the whole industry. How to use this information everyone decides for himself. We hope that it has come into your hands for creating and improving explanatory websites. If so, then remember: yes, you have a chance. But the captain of evidence is not tired of reminding: keep in mind that people will walk on your site - it is up to them to decide who you are and where you will be in the near future. At least, the new changes fit well with the policy of Yandex announced at the beginning of the year regarding the consideration of behavioral factors .

The business analyst for the Internet industry itself is widely available, and the ability to draw the right conclusions allows you to see the whole picture, even where information from other sources is not disclosed. We will continue to keep you updated on what is happening this summer - stay with us.