# # Robots Exclusion Protocol (robots.txt) # http://www.robotstxt.org/wc/norobots.html # # standard exclusions for some access-controlled areas User-agent: * Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_pvt/ Disallow: /_vti_log/ Disallow: /_vti_txt/ Disallow: /_private/ Disallow: /cgi-bin/