Crawlers indexing my MultiMode pictures take a suprising amount of bandwidth.
authorW. Trevor King <wking@drexel.edu>
Thu, 23 Feb 2012 12:34:19 +0000 (07:34 -0500)
committerW. Trevor King <wking@drexel.edu>
Thu, 23 Feb 2012 12:34:19 +0000 (07:34 -0500)
robots.txt

index 7e88eea1ba5ddc8e9b9ffa70f421155fddfa69ce..002115dbf16a568a71842f969388e18f65180127 100644 (file)
@@ -1,3 +1,13 @@
 # Don't allow robots into the blog
 #User-agent: *
 #Disallow: /
+
+# Don't allow robots to grab the big MultiMode pictures.
+User-agent: *
+Disallow: /posts/MultiMode/multimode_assembled.jpg
+Disallow: /posts/MultiMode/multimode_interior_0.jpg
+Disallow: /posts/MultiMode/multimode_main_board_chips.jpg
+Disallow: /posts/MultiMode/stepper/backlash/step_backlash.png
+Disallow: /posts/MultiMode/stepper/break_in_box.jpg
+Disallow: /posts/MultiMode/stepper/step_size.png
+Disallow: /posts/MultiMode/stepper/switch/DPDT.svg