# following prevents access to all files for spiders
User-Agent: *
Disallow: ../cgi-bin/
Disallow: ../log