# directed to all spiders

User-agent: *
Disallow: /images
Disallow: /docs
Disallow: /media
Disallow: /cgi-bin