2014-04-09 07:02:20 +00:00
|
|
|
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
|
2011-05-06 02:38:25 +00:00
|
|
|
#
|
|
|
|
|
# To ban all spiders from the entire site uncomment the next two lines:
|
2013-12-02 21:47:02 +00:00
|
|
|
# User-agent: *
|
2011-05-06 02:38:25 +00:00
|
|
|
# Disallow: /
|
