http://www.slowmyfood.com
Server iis
path from the errors: D:\inetpub\webs\slowmyfoodcom\
software Shopfactory
there's a robots.txt in a subfolder
http://www.slowmyfood.com/pub/robots.txt
# robots.txt for http://ou-8918-jg.shopfactory.com/ User-agent: * Allow: * Disallow: */contents/pconfirm.html Disallow: */contents/progress.html Disallow: */contents/provider.html Disallow: */contents/reseller.html Disallow: */contents/ups.html Disallow: */contents/basket.php Disallow: */contents/*/changecurrency.html Disallow: */contents/*/customerdtl.html Disallow: */contents/*/login.html Disallow: */contents/*/orderterms.html Disallow: */contents/*/ordertotal.html Disallow: */contents/*/search.html Disallow: */contents/*/search_result.html Disallow: */contents/*/shipping_charge.html Disallow: */contents/*/thankyou.html Disallow: */contents/*/unsuccessful.html Disallow: */contents/*/V6*.html Disallow: */contents/*/website.html Sitemap: http://ou-8918-jg.shopfactory.com/sitemap.xml
samples (the same language, as "it", for the second asterisk in the disallowed url):
http://www.slowmyfood.com/pub/contents/it/changecurrency.html
http://www.slowmyfood.com/pub/contents/en-uk/changecurrency.html
http://www.slowmyfood.com/pub/contents/it/orderterms.html
http://www.slowmyfood.com/pub/contents/it/website.html
http://www.slowmyfood.com/pub/contents/it/contactus.html (not listed but available)
Comments
Post a Comment