Bug 6411 - add another example to README.robots file
Summary: add another example to README.robots file
Status: CLOSED FIXED
Alias: None
Product: Koha
Classification: Unclassified
Component: Searching (show other bugs)
Version: 3.4
Hardware: All All
: PATCH-Sent (DO NOT USE) enhancement (vote)
Assignee: Galen Charlton
QA Contact: Bugs List
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-05-26 07:40 UTC by Mason James
Modified: 2012-10-25 23:09 UTC (History)
2 users (show)

See Also:
Change sponsored?: ---
Patch complexity: ---
Documentation contact:
Documentation submission:
Text to go in the release notes:
Version(s) released in:


Attachments
patch (676 bytes, patch)
2011-05-26 07:51 UTC, Mason James
Details | Diff | Splinter Review
new patch (1.53 KB, patch)
2011-05-30 09:00 UTC, Mason James
Details | Diff | Splinter Review
Signed-off patch (1.53 KB, patch)
2011-06-15 06:48 UTC, Magnus Enger
Details | Diff | Splinter Review

Note You need to log in before you can comment on or make changes to this bug.
Description Mason James 2011-05-26 07:40:23 UTC
adding this proposed robots.txt file allows good searchbot indexing for Koha

but also stops searchbots from thrashing Koha systems by refusing to traverse opac-search.pl urls.

here's the proposed robots.txt file

---------------
User-agent: *
Disallow: /cgi-bin/koha/opac-search.pl
---------------
Comment 1 Mason James 2011-05-26 07:51:08 UTC Comment hidden (obsolete)
Comment 2 Chris Cormack 2011-05-28 07:13:00 UTC
Please remember to set the patch status to needs sign off so the patch isnt missed.
Comment 3 Mason James 2011-05-30 08:36:37 UTC
(In reply to comment #0)
> adding this proposed robots.txt file allows good searchbot indexing for Koha
> 

aah, i see there is already an README-robots.txt file in the repo

i'll add this info to the 'README-robots.txt' file, instead
Comment 4 Mason James 2011-05-30 09:00:21 UTC Comment hidden (obsolete)
Comment 5 Magnus Enger 2011-06-15 06:47:48 UTC
Just adds another example to README.robots, not much to test beyond the fact that the patch applies.
Comment 6 Magnus Enger 2011-06-15 06:48:22 UTC
Created attachment 4468 [details] [review]
Signed-off patch
Comment 7 Chris Cormack 2011-07-05 02:50:39 UTC
Pushed please test
Comment 8 Mason James 2011-07-20 14:51:22 UTC
tested, and closing...