Frequency dictionary banned sites

The study was conducted in order to create a corpus of words of sites blocked by government agencies of the Russian Federation.


From public sources, a list of references was obtained that are in the registry at the time of the study. There are a total of 24,515 links in the list.
')
For each url, we made a get-request from a country that has no legal restrictions on such acts.

Server responses were as follows:



Most of the sites are functioning completely and they are not going to overestimate their own views on life. Many use firewalls, cutting off potentially dangerous (in their opinion) visitors. A significant amount simply puts a redirect to a fresh white domain.

A couple of words about "bullet resistance". Take a look at the tld distribution (only 200 OK):



No less interesting is the distribution by country in which the blocked resources are physically located:





Interactive dictionary visualization

The article is not aimed at promoting something, but only reflects the existing reality. The resulting material may be useful to someone to conduct their own research.