# Tell every crawlers where it can't go
User-agent: *
Disallow: /scripts/
Disallow: /sphider/
Disallow: /demo/