Bug 6411 - add another example to README.robots file
Summary: add another example to README.robots file
Status: CLOSED FIXED
Alias: None
Product: Koha
Classification: Unclassified
Component: Searching (show other bugs)
Version: 3.4
Hardware: All All
: PATCH-Sent (DO NOT USE) enhancement
Assignee: Galen Charlton
QA Contact: Bugs List
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-05-26 07:40 UTC by Mason James
Modified: 2012-10-25 23:09 UTC (History)
2 users (show)

See Also:
Change sponsored?: ---
Patch complexity: ---
Documentation contact:
Documentation submission:
Text to go in the release notes:
Version(s) released in:
Circulation function:

Attachments
patch (676 bytes, patch)
2011-05-26 07:51 UTC, Mason James 		Details | Diff | Splinter Review
new patch (1.53 KB, patch)
2011-05-30 09:00 UTC, Mason James 		Details | Diff | Splinter Review
Signed-off patch (1.53 KB, patch)
2011-06-15 06:48 UTC, Magnus Enger 		Details | Diff | Splinter Review
Show Obsolete (2) View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Mason James 2011-05-26 07:40:23 UTC 
adding this proposed robots.txt file allows good searchbot indexing for Koha

but also stops searchbots from thrashing Koha systems by refusing to traverse opac-search.pl urls.

here's the proposed robots.txt file

---------------
User-agent: *
Disallow: /cgi-bin/koha/opac-search.pl
---------------
Comment 1 Mason James 2011-05-26 07:51:08 UTC Comment hidden (obsolete)
Comment 2 Chris Cormack 2011-05-28 07:13:00 UTC 
Please remember to set the patch status to needs sign off so the patch isnt missed.
Comment 3 Mason James 2011-05-30 08:36:37 UTC 
(In reply to comment #0)
> adding this proposed robots.txt file allows good searchbot indexing for Koha
> 

aah, i see there is already an README-robots.txt file in the repo

i'll add this info to the 'README-robots.txt' file, instead
Comment 4 Mason James 2011-05-30 09:00:21 UTC Comment hidden (obsolete)
Comment 5 Magnus Enger 2011-06-15 06:47:48 UTC 
Just adds another example to README.robots, not much to test beyond the fact that the patch applies.
Comment 6 Magnus Enger 2011-06-15 06:48:22 UTC 
Created attachment 4468 [details] [review]
Signed-off patch
Comment 7 Chris Cormack 2011-07-05 02:50:39 UTC 
Pushed please test
Comment 8 Mason James 2011-07-20 14:51:22 UTC 
tested, and closing...