robots.txt

[auntie22]

Hello Everyone,

I did a check on my error log to make sure all was working correctly and I got this error:

File does not exist: /home/adults10/public_html/404.shtml
File does not exist: /home/adults10/public_html/robots.txt

can someone please help?

Thank you,
auntie22

[Arpit]

auntie22,
robots.txt has something 2 do with exclusion of robots from particular urls or webservers for that matter, for more info, check this out, http://www.robotstxt.org/