# Make changes for all web spiders


User-agent: *
Disallow: /test
Disallow: /js/
Disallow:/cgi-bin/