## disallow all robots #User-agent: * #Disallow: / # too extreme: lets protect a narrower set, including the "physics" pages User-agent: * Disallow: /cgi-bin/ Disallow: /error/ Disallow: /icons/ Disallow: /images/ Disallow: /manual/ Disallow: /usage/ Disallow: /tmp/ Disallow: /html/physics