Now officially anonsirovano 11 robots of a Yandex, each of which specializes on the certain problem .

1. Yandex/1.01.001 (compatible; Win16; I) - the basic conducting the indexation robot of a Yandex. It is the most important robot, which function - search and indexing of the information found on open spaces of the Russian Internet. For all SEO-experts it is important to trace occurrence on the sites first of all this robot - indeksatora. Usually the robot comes from the following ip-addresses: 213.180.206.4, 213.180.206.1, 213.180.216.4, 213.180.206.248, 213.180.216.28. Therefore, having seen in broad gullies of the site a treasured word yandex, pay the attention to an ip-address therefore as on the Internet now there is a sufficient plenty of services of testing of a site which allow to come on pages, being represented as user agent: Yandex/1.01.001 (compatible; Win16; I) Can appear, that at all and not the Yandex has visited your site.

2. Yandex/1.01.001 (compatible; Win16; P) - indeksator pictures which subsequently will be accessible in search a Yandex. A picture (http://images.yandex.ru <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fimages.yandex.ru>). For the search engine in the most simple way of definition, whether there corresponds{meets} a picture to search of the user, the analysis tega alt is. The second way which as well as the first most likely uses service a Yandex. A picture - the analysis of a name of a file. For example, see at lotuses on page (http://en.npftravel.ru/news/issue_117.html <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fen.npftravel.ru%252Fnews%252Fissue_117.html>). Any mention of a word "lotus" in a body of the document, however the picture all the same has been found on search "lotus" due to that the file has a name lotos.jpg.

3. Yandex/1.01.001 (compatible; Win16; H) - the robot determining mirrors of sites. A problem  of this robot - definition of a degree of similarity of two documents. If documents are very similar against each other, as a result of delivery a Yandex, most likely, will show only one site, process consists in it actually and zazerkalivanija. That is the site - mirror represents anything other, as a full copy of a site.

4. Yandex/1.03.003 (compatible; Win16; D) - the robot determining availability of page for indexation at its  addition through the form « To add URL » <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fwebmaster.yandex.ru%252F>.

5. Yandex/1.03.000 (compatible; Win16; M) - the robot visiting{attending} page at its  opening under the link « the Found words », are lower snippeta.

6. YaDirectBot/1.0 (compatible; Win16; I) - the robot which is conducting the indexation of pages of sites, participating in an advertising network of a Yandex.

7. Yandex/1.02.000 (compatible; Win16; F) - the robot which is conducting the indexation of icons of sites (favicons) which are shown then as a result of search to the left of the link to the found site.

Process of indexation of the document

Process of indexation of the document by robots of search engines, as a rule, begins with addition of a site in the form on special page. For a Yandex it is page http://webmaster.yandex.ru/. <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fwebmaster.yandex.ru%252F.> Here it is required to enter only the address of the site, any additional given to bring it is not required. In a Rambler, for example, it is required to specify still the name of a site, to give the brief description of a registered site and the contact person.

If the site is added for the first time a Yandex will give out the message:

« The address http://example.com/ <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fexample.com%252F> it is successfully added. In process of detour of the robot he will be proindeksirovan and becomes searchable ».

If the site was already visited{attended} by the robot - indeksatorom the message will appear:

« The document http://example.com/ <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fexample.com%252F> already proindeksirovan also it is searchable.

You can see, what pages of a site http://example.com/ <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fexample.com%252F> are accessible in a Yandex by present{true} time (* pages) ».

After addition of a new site through the form, it{he} will be visited there and then with robot Yandex/1.03.003 (compatible; Win16; D). He will define  availability of a site to indexing, and also will establish, whether satisfies a site to requirements of a Yandex, basic of which is "russkojazychnost`" a resource. Therefore, as the example, can arise such situation:

« The address http://www.example.com/ <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fwww.example.com%252F> has not been brought in base of a Yandex, as a site http://www.example.com/ <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fwww.example.com%252F> is outside of domains of the countries CIS, thus our robot could not distinguish in him Russian text ».

If very well in broad gullies of a site it will be possible to find out a line:

213.180.206.223 - [18/Jul/2006:10:22:08 +0400] " GET /robots.txt HTTP/1.1 " 404296 "-" " Yandex/1.03.003 (compatible; Win16; D) "

213.180.206.223 - [18/Jul/2006:10:22:08 +0400] " GET / HTTP/1.1 " 2002674 "-" " Yandex/1.03.003 (compatible; Win16; D) "

It is visible, that all over again the robot has addressed to a file robots.txt (it  in this case simply does not exist) to define , whether the site to indexation is forbidden. Then has addressed to the main page.

After addition of a site on page http://webmaster.yandex.ru/ <http: // www.internet-technologies.ru/? url=http%253A%252F%252Fwebmaster.yandex.ru%252F> less than in two days the site will visit robot - indeksator Yandex/1.01.001 (compatible; Win16; I). And more after a while the site will be searchable in a Yandex.