While Google is changing search algorithms to reduce the weight of garbage sites, other search engines go to more drastic measures. Yesterday, the
Blekko system banned 1.1 million domains at once, where "too little content and too much advertising."
Exclusion of sites from the Blekko issue began last month with
twenty sites , including eHow and Answerbag (owned by the Demand Media copywriting empire), which users most often complained about. As you know, search results in Blekko are filtered based on user feedback.
“Google didn't really exclude anyone, but just shuffled the deck. Instead of downgrading these sites to the fifth or seventh position, we simply threw them out, ”the well-known hacker and search engine developer Richard Skrent said in his directness.
The main reason for deleting sites was that they belong to moneymakers who do not work on creating content, but simply earn money from online advertising: “If you make a machine for printing money, then people will find it. - says Skrent in
an interview with the NY Times . - They just write a few words on the page, exchange links and register in the search engines. Then traffic appears and checks begin to arrive. ”
')
Of course, most normal websites also make money on online advertising, so the self-learning algorithm AdSpam takes into account various factors for calculating moneymakers: the minimum or zero amount of content, numerous ad units on a page, the website has a narrow thematic focus. As stated in the
official blog , the algorithm is specifically designed with a view to excluding moneymaker sites
before they are indexed . This is a good way to simultaneously reduce the load on a poor search infrastructure of a startup (there are only
800 servers in Blekko) and at the same time significantly improve the search quality.
Many good sites, for example, general newspaper sites, formally fall under the “spam” parameters of Blekko, but the AdSpam algorithm under human supervision coped with the task almost without fail. Skrenta says that he personally reviewed a couple of thousand banned sites and found only two false positives.
Launched in
October 2010, the search engine Blekko now processes about 1 million search queries per day from a monthly audience of 500,000 users.