robots.txt Sample File

[michael_s]

A robots.txt file can tip a hacker off to files that they might find interesting and would otherwise not know about. It is much safer to edit the PHP files themselves to include a robots meta tag instead.

Use your HTML editor to search all files in your osCommerce install in source mode for "" (quotes just delimit what you are looking for and should not be included in the actual search). Immediately under this tag add one of the following two tags:

If the file in question is located in the admin directory it should not get indexed at all so you will want to add the meta tag to prevent any robot access to the file as follows:



For files in your main catalog that you don't want indexed you will still want the robot to continue indexing the remainder of the site so you would use:




More...