projects
/
feedcatcher.git
/ commitdiff
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
| commitdiff |
tree
raw
|
patch
| inline |
side by side
(parent:
4fe7e6f
)
robots.txt now bans all robots
author
Neil Smith
<neil.git@njae.me.uk>
Wed, 8 Jan 2014 14:17:16 +0000
(14:17 +0000)
committer
Neil Smith
<neil.git@njae.me.uk>
Wed, 8 Jan 2014 14:17:16 +0000
(14:17 +0000)
public/robots.txt
patch
|
blob
|
history
diff --git
a/public/robots.txt
b/public/robots.txt
index 1a3a5e4dd2502ac121c22f743c4250e254a94eeb..b19a37782ced13159dfea2756ebdaeef5bcfa046 100644
(file)
--- a/
public/robots.txt
+++ b/
public/robots.txt
@@
-1,5
+1,5
@@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
-
#
User-agent: *
-
#
Disallow: /
+User-agent: *
+Disallow: /