Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yandex's documentation about implemented robots.txt features:

http://help.yandex.com/webmaster/controlling-robot/robots-tx...

Yandex's online tool to check specific URL on allowness in robots.txt:

http://webmaster.yandex.com/robots.xml



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: