# Stop MSNBot from traversing the site: 
User-agent: msnbot
Disallow: / 
User-agent: Slurp
Disallow: /
User-agent: baiduspider
Disallow: /
User-agent: Speedy
Disallow: /