User-Agent: * Disallow: /google*.html User-Agent: semalt* Disallow: / User-Agent: Yandex* Disallow: / User-Agent: urlmetrics* Disallow: / User-agent: meanpathbot Disallow: / User-Agent: * Disallow: /*htaccess Disallow: /*htacl Disallow: /php.ini Disallow: /*m1n/ Disallow: /*min/ Disallow: /*min*/ Disallow: /*min* Disallow: /administrator/ Disallow: /image/ Disallow: /config*