📜 ⬆️ ⬇️

Does the site require registration? Use Google

This is a slightly abbreviated translation of an article from the Google Operating System blog on how indexation of closed content works. Perhaps this thing has long been known, then consider this note unnecessary.

Some sites provide different content depending on which page the visitor made the transition. News sites, such as the New York Times, open many articles only to their subscribers, but make an exception if a visitor navigates from the Google search page and other popular search engines.

Google has a feature called first click free for sites that require a subscription. It is designed to protect your content and at the same time enable indexing. To implement First Click Free, the webmaster must allow all users who have found your page through Google to see the full text of the document without the need to register or subscribe.
')
However, despite the fact that the initial entrance to the site is free, when the user clicks on internal links, the site will require registration. This is especially inconvenient for resources like nytimes.com, which break up a large article into pages to increase the number of views.

You can get around this very simply - copy the link to the page to which you do not have access to the Google search string and then go to the first search result. If Google has not indexed this page, you can use SearchWiki to add the page to the list of search results: make sure you are logged in to your Google account and click "Add a result" at the bottom of the search results page:

image

The comments to the original article indicate a simpler solution - use the RefSpoof or RefControl extensions for Firefox and specify www.google.com as the referrer.

Source: https://habr.com/ru/post/59110/


All Articles