projects
/
feedcatcher.git
/ blobdiff
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
|
commitdiff
|
tree
raw
| inline |
side by side
robots.txt now bans all robots
[feedcatcher.git]
/
public
/
robots.txt
diff --git
a/public/robots.txt
b/public/robots.txt
index 1a3a5e4dd2502ac121c22f743c4250e254a94eeb..b19a37782ced13159dfea2756ebdaeef5bcfa046 100644
(file)
--- a/
public/robots.txt
+++ b/
public/robots.txt
@@
-1,5
+1,5
@@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
-
#
User-agent: *
-
#
Disallow: /
+User-agent: *
+Disallow: /