Re: The goods on Hotbot's spider

[ Reply To This Message ]

Re: The goods on Hotbot's spider

From Joe on 09 July '98
adding to Re: The goods on Hotbot's spider posted by Ronny Skog

>From the HotBot help file:

>"My page has changed / moved. How do I get it updated in your index? HotBot updates its entire database regularly. Your pages should be updated within two weeks, or you can request a quicker update by adding the URL of the changed page to HotBot. See How can I get my pages into HotBot? for more information."

>In my experience the spider never re index after 2-3 weeks. I have a 404 page in their index witch has been there for about tree months! One of my other (valid) pages appear 3 times in the results.

Well, If the "dead" page was never submitted by hand, and there are no existing links to it, then it might not get spidered again for a very long time.

Replies from other people:

*Reply to this message:*
Who Are You?
Your name:
Home page title: (optional)
Home page URL: (optional)

Your Reply:
Subject:
Reply:	>>From the HotBot help file: >>"My page has changed / moved. How do I get it updated in your index? HotBot updates its entire database regularly. Your pages should be updated within two weeks, or you can request a quicker update by adding the URL of the changed page to HotBot. See How can I get my pages into HotBot? for more information." >>In my experience the spider never re index after 2-3 weeks. I have a 404 page in their index witch has been there for about tree months! One of my other (valid) pages appear 3 times in the results. >Well, If the "dead" page was never submitted by hand, and there are no existing links to it, then it might not get spidered again for a very long time.