Spiders unwilling to follow links

[ Reply To This Message ]

Spiders unwilling to follow links

From Jonas Nordstrand at Webhoo! Webpublishing Resources on 03 May '98

I've submitted my site several times to all
major search engines.

How-ever have only HotBot and Northern Light
followed all internal links and spidered
the 50+ pages I carry. Most of the engines
just spider (and index) the page I'm submitting
not the pages which there are links to.

Why is that? Am I penalized for something I'm
not aware of?

(Yes, I've waited. At least two months and
still no full site spidering.)

Replies from other people:

Re: Spiders unwilling to follow links Max - 04/5/98
- Re: Spiders unwilling to follow links Jonas Nordstrand - 04/5/98

*Reply to this message:*
Who Are You?
Your name:
Email:
Home page title: (optional)
Home page URL: (optional)

Your Reply:
Subject:
Reply:	>I've submitted my site several times to all >major search engines. >How-ever have only HotBot and Northern Light >followed all internal links and spidered >the 50+ pages I carry. Most of the engines >just spider (and index) the page I'm submitting >not the pages which there are links to. > Why is that? Am I penalized for something I'm > not aware of? > (Yes, I've waited. At least two months and >still no full site spidering.)