---

[ March Full List | Reply ]

---

Re: robots.txt From Inachu on 20 March '01 replying to Re: robots.txt posted by David A Yes I agree but <img src="*.*> would never work but I wish the web was flexible like this.... Inachu >>I noticed palm(http://www.palm.com/robots.txt) has their robots.txt file just uses an asterisk to ban spiders. >> >>Does the asterisk work or must you specify every spider agent? >> >> >> >> >>Inachu > >Typically the asterisk is a wildcard meaning "all".

Reply to this message
Required Details
Your name:
Subject:

Optional Details
Home page title:
Home page URL:
Email:	(if you'd like to receive automatic replies by email)
Your Message
>Yes I agree but <img src="*.*> would never work but I wish the web was flexible like this.... > > > >Inachu > > >>>I noticed palm(http://www.palm.com/robots.txt) has their robots.txt file just uses an asterisk to ban spiders. >>> >>>Does the asterisk work or must you specify every spider agent? >>> >>> >>> >>> >>>Inachu >> >>Typically the asterisk is a wildcard meaning "all".