# Created by Steve J. Riggall to advertise the sitemap location and prevent crawling of private folders. # Note that I have intentionally left the Pages folder open. User-Agent: * Allow: /scripts/generatesitemap.aspx Disallow: /scripts Disallow: /bin Allow: /offers Disallow: /feeds Disallow: /logs Disallow: /mailer Disallow: /productinfo Allow: / Disallow: /uploads Disallow: /aspnet_client Disallow: /configuration Disallow: /admin Sitemap: http://greenstreet-online.com/scripts/generatesitemap.aspx