Detect blocked resources using Google webmaster tools
Hi, Habrahabr! It has already happened that modern web content literally stands on three pillars: HTML5, CSS3 and Javascript. The tight integration of these three tools allows you to create truly impressive results, but today we are not talking about the achievements of modern web-based industry, but about how these achievements are properly conveyed to users.
For display of your site at users, by itself, browsers are responsible. But how does the site see the search engine? What will she see if some of the content (pictures, style sheets, scripts) is closed from scanning? What will users see in search results if Google cannot index all the necessary content? Specifically, to answer these questions (as well as to correct some misunderstandings that prevent you from finding your users on Google), we created the Blocked Resource Report tool.
Today we present it to a wide audience of developers and webmasters, and you can get to know him and try out the possibilities of the new tool among the first.
')
Here is the verification report:
Inside the report, you will find a list of hosts unavailable to Googlebot that your site links to. These can be links to images, CSS, libraries, and JavaScript modules.
Each line is clickable and contains a list of resources that are located on this host, as well as the pages of your site on which they are located. The system will offer you some possible solutions to problems related to content indexing.
We also updated the Fetch and Render mode: if previously it showed your site only from the Googlebot point of view, now you’ll receive two screenshots at once, one with the result of rendering the page for Google’s search robot, the other - for site visitors. Comparing these images, you can easily identify potential problems.
We are well aware that webmasters do not always have the opportunity to influence the behavior of external resources. In Webmaster Tools, we try to display only those hosts whose scan settings you can change. In the list of "problem areas" you will not see the URLs associated with some external resources, for example, popular web analytics services.
We have tried to exclude from the list the most obvious resources, but if you still get something that you think is not the place, let us know . We are closely following the reviews of webmasters and developers about our tools and we try to respond promptly to all comments and suggestions coming to our forum.
Due to various (and not necessarily technical) reasons, updating all robots.txt files can take a lot of time, so we recommend starting with resources that block the page most of all. Detailed instructions can be found in this article .
We hope that our new tools will help you to quickly find blocked resources on the site and fix them. If you have questions - ask them in the comments, on our forum or in the community for webmasters .
For display of your site at users, by itself, browsers are responsible. But how does the site see the search engine? What will she see if some of the content (pictures, style sheets, scripts) is closed from scanning? What will users see in search results if Google cannot index all the necessary content? Specifically, to answer these questions (as well as to correct some misunderstandings that prevent you from finding your users on Google), we created the Blocked Resource Report tool.
Today we present it to a wide audience of developers and webmasters, and you can get to know him and try out the possibilities of the new tool among the first.
')
Here is the verification report:
Inside the report, you will find a list of hosts unavailable to Googlebot that your site links to. These can be links to images, CSS, libraries, and JavaScript modules.
Each line is clickable and contains a list of resources that are located on this host, as well as the pages of your site on which they are located. The system will offer you some possible solutions to problems related to content indexing.
Watch as Googlebot: now two screenshots instead of one
We also updated the Fetch and Render mode: if previously it showed your site only from the Googlebot point of view, now you’ll receive two screenshots at once, one with the result of rendering the page for Google’s search robot, the other - for site visitors. Comparing these images, you can easily identify potential problems.
We are well aware that webmasters do not always have the opportunity to influence the behavior of external resources. In Webmaster Tools, we try to display only those hosts whose scan settings you can change. In the list of "problem areas" you will not see the URLs associated with some external resources, for example, popular web analytics services.
We have tried to exclude from the list the most obvious resources, but if you still get something that you think is not the place, let us know . We are closely following the reviews of webmasters and developers about our tools and we try to respond promptly to all comments and suggestions coming to our forum.
Due to various (and not necessarily technical) reasons, updating all robots.txt files can take a lot of time, so we recommend starting with resources that block the page most of all. Detailed instructions can be found in this article .
We hope that our new tools will help you to quickly find blocked resources on the site and fix them. If you have questions - ask them in the comments, on our forum or in the community for webmasters .
Source: https://habr.com/ru/post/252749/
All Articles