Robots.txt

[Kaltech]

Hi,

I have created a robots.txt file in notepad. Can any one tell me how I would load this up?

Many thanks.

[Merlin_AZ]

Are you trying to make that file downloadable if someone clicks on a link?
Or are you trying to do something else with it?

[Jimi King]

You should put it (presumably via FTP) in the same directory as your index.html file

[steve.ledger]

Or are you trying to do something else with it?

The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable.


As Jimi mentioned, it should go in the site root directory.

[Kaltech]

thanks every one for your help, I think I have sorted it now. Its nice to have you guys on hand for advice.