Comments on: wordpress robots.txt http://ejikas.com/wordpress-robotstxt/ walker through life. I gues slowly, not running. Tue, 15 Mar 2011 14:20:39 +0000 hourly 1 http://wordpress.org/?v=3.1 By: ejikas http://ejikas.com/wordpress-robotstxt/comment-page-1/#comment-4835 ejikas Mon, 30 Jun 2008 20:00:28 +0000 http://ejikas.com/?p=11#comment-4835 one update on that. decided to disallow indexing categories for a while as well. Still not sure about my blog structure. It's ok to keep closed it for a while. so added at the bottom: Disallow: /theme/ as category base name I set [theme] instead of [category]. one update on that. decided to disallow indexing categories for a while as well. Still not sure about my blog structure. It’s ok to keep closed it for a while.

so added at the bottom:
Disallow: /theme/

as category base name I set [theme] instead of [category].

]]>