Unindexed: a website that permanently deletes itself after indexing

"Unindexed site" Unindexed can not be found through a search engine. The program constantly monitors search results, and if it appears there it immediately deletes all information.



The author Matthew Rothenberg (Matthew Rothenberg) believes that the concept of "non-indexable sites" is suitable for launching "secret" communities, which are known only to selected users. They transmit information through tangible media in the real world and nowhere on the Internet mention the name of the site, just like in the movie "Fight Club".



The appearance of a search bot here equates to the loss of disguise. So to say, “turnout failed”, to put it in the language of intelligence.

')

Of course, you can simply prevent the site from being indexed through the instructions in the robots.txt file, but this still does not guarantee the absence of search results.



Matthew conducted an experiment with self-removal of his own site. The experiment lasted 22 days before the site appeared in the issue of Google. This happened on February 24, 2015 at 21 h 01 min 14 sec. For a few moments he was completely erased.



The author did not use any methods to protect against indexing, only indicated the NOARCHIVE meta tag, which prohibits caching of content by search engines. Thus, after deleting a site, information cannot be recovered from a cached copy to Google.



The content of the site is stored only in RAM (used by Redis) and is loaded via a file in the encrypted partition of the hard disk. This section is deleted immediately after the launch of the site. Redis backups are disabled. Well, the contents of the RAM is cleared when the Google check gives an alarm.