# Robots.txt file from http://www.yuyi..net # All robots will spider the domain User-Agent: * Disallow: /cgi-bin/ Disallow: /~pauline/cgi-bin/ Allow: /