deadlock Message Board
[ March Full List | Reply ]

Re: code to get robots to ignore certain pages
From David A on 13 March '00
replying to code to get robots to ignore certain pages posted by judy

>Is there html code that will tell the robots to ignore certain pages like th "OK" and "NOT OK" pages of my forms?

Yes, create a robots.txt file in your main directory and put this in it :

User-agent: *
Disallow: /cgi-bin/
Disallow: /errors/
Disallow: /whateverpages.htm you want




Reply to this message

Required Details
Your name:
Subject:

Optional Details
Home page title:
Home page URL:
Email:
(if you'd like to receive automatic replies by email)

Your Message