# /robots.txt file for various crawlers # User-agent: * Disallow: /gifs Disallow: /images Disallow: /scripts