{"id":830,"date":"2007-04-18T20:59:37","date_gmt":"2007-04-18T20:59:37","guid":{"rendered":"https:\/\/wordpress.org\/plugins-wp\/kb-robotstxt\/"},"modified":"2008-03-21T20:37:35","modified_gmt":"2008-03-21T20:37:35","slug":"kb-robotstxt","status":"closed","type":"plugin","link":"https:\/\/yor.wordpress.org\/plugins\/kb-robotstxt\/","author":141553,"comment_status":"closed","ping_status":"closed","template":"","meta":{"version":"1.0.1","stable_tag":"trunk","tested":"2.5","requires":"2.0","requires_php":"","requires_plugins":"","header_name":"KB Robots.txt","header_author":"Adam R. Brown","header_description":"","assets_banners_color":"","last_updated":"2017-11-28 12:51:30","external_support_url":"","external_repository_url":"","donate_link":"http:\/\/adambrown.info\/b\/widgets\/donate\/","header_plugin_uri":"http:\/\/adambrown.info\/b\/widgets\/kb-robots-txt\/","header_author_uri":"http:\/\/adambrown.info\/","rating":5,"author_block_rating":0,"active_installs":1000,"downloads":106151,"num_ratings":0,"support_threads":0,"support_threads_resolved":0,"author_block_count":0,"sections":["description","installation","faq"],"tags":[],"upgrade_notice":[],"ratings":{"1":0,"2":0,"3":0,"4":0,"5":"1"},"assets_icons":[],"assets_banners":[],"assets_blueprints":{},"all_blocks":[],"tagged_versions":[],"block_files":[],"assets_screenshots":[],"screenshots":[]},"plugin_section":[],"plugin_tags":[150,6499,12753,944,186],"plugin_category":[51,55],"plugin_contributors":[78703],"plugin_business_model":[],"class_list":["post-830","plugin","type-plugin","status-closed","hentry","plugin_tags-google","plugin_tags-robots","plugin_tags-robots-txt","plugin_tags-search","plugin_tags-seo","plugin_category-multisite","plugin_category-seo-and-marketing","plugin_contributors-adamrbrown","plugin_committers-adamrbrown"],"banners":[],"icons":{"svg":false,"icon":"https:\/\/s.w.org\/plugins\/geopattern-icon\/kb-robotstxt.svg","icon_2x":false,"generated":true},"screenshots":[],"raw_content":"\n

When robots (like the Googlebot) crawl your site, they begin by requesting http:\/\/example.com\/robots.txt<\/code> and checking it for special instructions. Use this plugin to create and edit your robots.txt file from within Wordpress (using Options -> Robots.txt<\/code>).<\/p>\n\n

Whenever a user (or a robot, more likely) appends \"robots.txt\" to your blog URL (e.g. http:\/\/blog.example.com\/robots.txt), this plugin will serve up the robots.txt file that you created in the Wordpress admin menu.<\/p>\n\n

This plugin should work with most versions of Wordpress, but it is particularly intended for WP-MU installations, since it allows each WPMU blog to have a unique robots.txt file.<\/p>\n\n

Limitations<\/h4>\n\n

Note that robots make only top-level requests for robots.txt files. If you have Wordpress installed in a subdomain (e.g. http:\/\/blog.example.com\/<\/code>) or in your root (e.g. http:\/\/example.com\/<\/code>), this plugin will work as intended. But if you have Wordpress installed in a subdirectory (e.g. http:\/\/example.com\/blog\/<\/code>), then this plugin won't do much for you, since the search engines won't look for http:\/\/example.com\/blog\/robots.txt<\/code>, only for http:\/\/example.com\/robots.txt<\/code>.<\/p>\n\n

Also, requires that you be using some form of permalink structure. If links to blog posts look like http:\/\/example.com\/index.php?p=36<\/code>, this won't work.<\/p>\n\n

Support<\/h4>\n\n

If you post your support questions as comments below, I probably won't see them. If the FAQs don't answer your questions, you can post support questions at the KB Robots.txt plugin page<\/a> on my site.<\/p>\n\n

License<\/h3>\n\n

This plugin is provided \"as is\" and without any warranty or expectation of function. I'll probably try to help you if you ask nicely, but I can't promise anything. You are welcome to use this plugin and modify it however you want, as long as you give credit where it is due.<\/p>\n\n

I give this away for free. If you run a blog farm (WP-MU), you can't charge people to use this plugin. Unless, of course, you want to share the wealth with the person who coded this...<\/p>\n\n\n

    \n
  1. Upload kb_robots-txt.php<\/code> to the \/wp-content\/plugins\/<\/code> directory.<\/li>\n
  2. Activate the plugin through the 'Plugins' menu in WordPress.<\/li>\n
  3. Go to the new 'Options => KB Robots.txt' admin page. In the box, write whatever you want your robots.txt file to say. There are examples below the box.<\/li>\n
  4. Test that it worked by going to http:\/\/yourblog.example.com\/robots.txt<\/code> to see your new robots.txt file.<\/li>\n<\/ol>\n\n\n
    \n
    Installation Instructions<\/dt>\n
      \n
    1. Upload kb_robots-txt.php<\/code> to the \/wp-content\/plugins\/<\/code> directory.<\/li>\n
    2. Activate the plugin through the 'Plugins' menu in WordPress.<\/li>\n
    3. Go to the new 'Options => KB Robots.txt' admin page. In the box, write whatever you want your robots.txt file to say. There are examples below the box.<\/li>\n
    4. Test that it worked by going to http:\/\/yourblog.example.com\/robots.txt<\/code> to see your new robots.txt file.<\/li>\n<\/ol><\/dd>\n
      Do I need a robots.txt file?<\/dt>\n

      All well-behaved robots (which includes all search engine spiders) will request http:\/\/example.com\/robots.txt before doing anything else. If you wish to allow all robots access to your entire site, then you do not need this plugin.<\/p>\n\n

      You need robots.txt (and therefore this plugin) to achieve any of the following goals:<\/p>\n\n