Re: macromedia flash|
From Guillermo Uruchurtu on 12 April '99
replying to Re: macromedia flash posted by Zohn
>What about a norobots.txt file for the flash section? is there such a thing?
there is no such thing as norobot.txt.
A robot.txt file is a file in which you tell the spider,
what part of your site you want or you don't want to be spidered,
In AV words:
"gives you complete control over what fraction of your site is indexed."
The file looks like this:
User-agent: * <-this line you address
the robot.txt file to a specific robot (* means to all robots)
Disallow: /cgi-bin/sources <-You tell the robot what NOT to
and you can do this also with meta tags:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
So in other words, the robot.txt, is in fact a norobot.txt....
Hope it helps