Algorithm of the search engine SVLAB Search
Search engine SVLAB Search .
The new search engine allows you to add your pages in the search engine indexes using the plugin for Google Chrome .
After installing the plugin, you will be able to click the Save Page button.
Each page addition to the search engine is associated with your IP.
Thus, you can search on your page only from your IP.
The search engine is available at
svlaboratory.org/application/search and svlaboratory.com
')
Algorithm, implementation, technology stack.
Search engine indexes are stored in a MySQL database .
The text inside the html tags of the pages obtained after they are loaded and displayed dynamically in the user's browser is used as indexes. The text obtained after the transformation of words into the basic form by the Az.js morphological analyzer library is also used.
The same principle preserves the indexes of links to the media resources of the HTML page: hyperlinks, images, videos.
All indexes correspond to separate tables in the MySQL database, the individual lines of which correspond to the description of the pages being indexed.
Dynamic loading and parsing of pages is done by Google Chrome plugin using the jQuery library.
After the plugin is connected to the browser and the user on the desired page has clicked the “Save page” button, the parsing data is sent to a search engine web server written in PHP using the Zend Framework query application framework .
To search your pages, your data is associated with your IP address and the search request is sent from the web page of the application svlaboratory.org/application/search and svlaboratory.com to the Apache web action using the Ajax technology.
The search algorithm for the MySQL database is used as a page search algorithm.
To search for sentences - sentences are broken down into words, words are brought into basic form with a morphological analyzer. Searches for individual words.
In the first place in the search results displays the page in which found the most words, pairs of words, and the original sentences.
The specific implementation of a search engine in your case will depend only on your ability to program.
I invite everyone to use my search engine.
Best wishes,
Svlab
The new search engine allows you to add your pages in the search engine indexes using the plugin for Google Chrome .
After installing the plugin, you will be able to click the Save Page button.
Each page addition to the search engine is associated with your IP.
Thus, you can search on your page only from your IP.
The search engine is available at
svlaboratory.org/application/search and svlaboratory.com
')
Algorithm, implementation, technology stack.
Search engine indexes are stored in a MySQL database .
The text inside the html tags of the pages obtained after they are loaded and displayed dynamically in the user's browser is used as indexes. The text obtained after the transformation of words into the basic form by the Az.js morphological analyzer library is also used.
The same principle preserves the indexes of links to the media resources of the HTML page: hyperlinks, images, videos.
All indexes correspond to separate tables in the MySQL database, the individual lines of which correspond to the description of the pages being indexed.
Dynamic loading and parsing of pages is done by Google Chrome plugin using the jQuery library.
After the plugin is connected to the browser and the user on the desired page has clicked the “Save page” button, the parsing data is sent to a search engine web server written in PHP using the Zend Framework query application framework .
To search your pages, your data is associated with your IP address and the search request is sent from the web page of the application svlaboratory.org/application/search and svlaboratory.com to the Apache web action using the Ajax technology.
The search algorithm for the MySQL database is used as a page search algorithm.
To search for sentences - sentences are broken down into words, words are brought into basic form with a morphological analyzer. Searches for individual words.
In the first place in the search results displays the page in which found the most words, pairs of words, and the original sentences.
The specific implementation of a search engine in your case will depend only on your ability to program.
I invite everyone to use my search engine.
Best wishes,
Svlab
Source: https://habr.com/ru/post/460325/
All Articles