robots.txt ERRORFrom chuck at St. Croix
on 28 March '00
Hi,
In looking at my stats I noticed that under "Failed URL's" /st-croix/robots.txt was listed 11 times. Does this mean that the site was visited by robots 11 times and they couldn't get in? If so how do I fix it? Also, how do you tell when a robot has visited your site?