# robots.txt for http://www.vegagroup.com.au/ # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # Comments to the webmaster should be posted at # # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- # User-agent: Fast corporate crawler User-agent: * Disallow: /company/contact/response/thankyou.asp Disallow: /urgent/response/uologged.asp Disallow: /links/links.html Disallow: /usdgif Disallow: /usdjpg Disallow: /usdcss User-agent: EmailSiphon Disallow: / User-agent: CherryPicker Disallow: / #