User-agent: Yandex Disallow: / # prohibits crawling for the entire site