Froze rails gems
[depot.git] / vendor / rails / railties / html / robots.txt
diff --git a/vendor/rails/railties/html/robots.txt b/vendor/rails/railties/html/robots.txt
new file mode 100644 (file)
index 0000000..085187f
--- /dev/null
@@ -0,0 +1,5 @@
+# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
+#
+# To ban all spiders from the entire site uncomment the next two lines:
+# User-Agent: *
+# Disallow: /