Hi,
I have created a robots.txt file in notepad. Can any one tell me how I would load this up?
Many thanks.
Hi,
I have created a robots.txt file in notepad. Can any one tell me how I would load this up?
Many thanks.
Are you trying to make that file downloadable if someone clicks on a link?
Or are you trying to do something else with it?
You should put it (presumably via FTP) in the same directory as your index.html file
The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable.
As Jimi mentioned, it should go in the site root directory.
thanks every one for your help, I think I have sorted it now. Its nice to have you guys on hand for advice.
Bookmarks