Bug 5160

Summary: Default Zebra configuration : map lines in word-phrase-utf.chr
Product: Koha Reporter: Fridolin Somers <fridolin.somers>
Component: SearchingAssignee: Galen Charlton <gmcharlt>
Status: CLOSED FIXED QA Contact: Bugs List <koha-bugs>
Severity: normal    
Priority: P5 - low CC: colin.campbell
Version: rel_3_2   
Hardware: All   
OS: All   
Change sponsored?: --- Patch complexity: ---
Documentation contact: Documentation submission:
Text to go in the release notes:
Version(s) released in:
Attachments: Patch

Description Fridolin Somers 2010-08-23 08:53:14 UTC
In the Zebra indexing configuration file word-phrase-utf.chr, there are some "map" lines defined.

I wonder about those two : 
  map (^c)            @
  map (^C)            @

They mean that a starting "c" letter must be ignored.
For example, "Cristopher" will be indexed as "ristopher".

Is is a wanted behaviour ?

Shouldn't it be a "c" letter and a space : 
  map (^c\s)            @
  map (^C\s)            @

Other map lines should also be reviewed.
Comment 1 Colin Campbell 2010-08-23 10:33:43 UTC
I can confirm that removing these two lines and running a rebuild zebra fixes the strange zebra bug I experienced where headings starting with C were not being indexed correctly  (e.g. Chinese Poetry indexing as hinese poetry)

I think all these map entries where the string does not end with punctuation will be causing similar mis-filings
Comment 2 Colin Campbell 2010-08-23 12:01:06 UTC
Created attachment 2559 [details] [review]
Patch

Attached patch adds a space after initial strings that do not end in punctuation.

It does not address if this is the best way to handle this or what the default contents of this file should be. 
This does mean that C5 will no longer interfile with C 4 and C.6 but it will stop authors and titles beginning with C misfiling to allow this. (whether this was the requitement is hard to tell as no explanation is given on the commit that added the stop words
Comment 3 Galen Charlton 2010-10-28 12:13:05 UTC
Patch is in HEAD and 3.2.0.  Please test and close.
Comment 4 Fridolin Somers 2010-10-28 13:36:22 UTC
Tested ok.

Corresponding commit :
http://git.koha-community.org/gitweb/?p=koha.git;a=commit;h=1519497ea74339277b08a0eff66bc9e0b702b933