Majestic-12 distributed search dreams of Google laurels
What clearly hints at such a picture on your website: 
The main idea - instead of thousands of servers to shift the work of indexing on the local machines of users who provide their resources for free. To do this, register and download the client program.
The site has statistics - some people allocate a hundred gigabytes of their traffic per day to this project.
The project itself requires a good connection rather than a powerful processor, in contrast to the same Seti @ home, where there is little traffic - but the processor is loaded at the maximum. So bezlimitka only welcome.
While 37,534,707,760 URLs are indexed, given the distributed structure of the project, the volume and speed of indexing may exceed the capabilities of GOOGLE. The project is ambitious - but it has potential. I am surprised that Google itself did not create something like this. Revolution against the monopoly of Google? Who knows ...
www.majestic12.co.uk
The main idea - instead of thousands of servers to shift the work of indexing on the local machines of users who provide their resources for free. To do this, register and download the client program.
The site has statistics - some people allocate a hundred gigabytes of their traffic per day to this project.
The project itself requires a good connection rather than a powerful processor, in contrast to the same Seti @ home, where there is little traffic - but the processor is loaded at the maximum. So bezlimitka only welcome.
While 37,534,707,760 URLs are indexed, given the distributed structure of the project, the volume and speed of indexing may exceed the capabilities of GOOGLE. The project is ambitious - but it has potential. I am surprised that Google itself did not create something like this. Revolution against the monopoly of Google? Who knows ...
www.majestic12.co.uk
')
Source: https://habr.com/ru/post/16719/
All Articles