Bug 5160 - Default Zebra configuration : map lines in word-phrase-utf.chr
Summary: Default Zebra configuration : map lines in word-phrase-utf.chr
Status: CLOSED FIXED
Alias: None
Product: Koha
Classification: Unclassified
Component: Searching (show other bugs)
Version: rel_3_2
Hardware: All All
: P5 - low normal (vote)
Assignee: Galen Charlton
QA Contact: Bugs List
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-08-23 08:53 UTC by Fridolin Somers
Modified: 2012-10-25 22:52 UTC (History)
1 user (show)

See Also:
Change sponsored?: ---
Patch complexity: ---
Documentation contact:
Documentation submission:
Text to go in the release notes:
Version(s) released in:


Attachments
Patch (1.69 KB, patch)
2010-08-23 12:01 UTC, Colin Campbell
Details | Diff | Splinter Review

Note You need to log in before you can comment on or make changes to this bug.
Description Fridolin Somers 2010-08-23 08:53:14 UTC
In the Zebra indexing configuration file word-phrase-utf.chr, there are some "map" lines defined.

I wonder about those two : 
  map (^c)            @
  map (^C)            @

They mean that a starting "c" letter must be ignored.
For example, "Cristopher" will be indexed as "ristopher".

Is is a wanted behaviour ?

Shouldn't it be a "c" letter and a space : 
  map (^c\s)            @
  map (^C\s)            @

Other map lines should also be reviewed.
Comment 1 Colin Campbell 2010-08-23 10:33:43 UTC
I can confirm that removing these two lines and running a rebuild zebra fixes the strange zebra bug I experienced where headings starting with C were not being indexed correctly  (e.g. Chinese Poetry indexing as hinese poetry)

I think all these map entries where the string does not end with punctuation will be causing similar mis-filings
Comment 2 Colin Campbell 2010-08-23 12:01:06 UTC
Created attachment 2559 [details] [review]
Patch

Attached patch adds a space after initial strings that do not end in punctuation.

It does not address if this is the best way to handle this or what the default contents of this file should be. 
This does mean that C5 will no longer interfile with C 4 and C.6 but it will stop authors and titles beginning with C misfiling to allow this. (whether this was the requitement is hard to tell as no explanation is given on the commit that added the stop words
Comment 3 Galen Charlton 2010-10-28 12:13:05 UTC
Patch is in HEAD and 3.2.0.  Please test and close.
Comment 4 Fridolin Somers 2010-10-28 13:36:22 UTC
Tested ok.

Corresponding commit :
http://git.koha-community.org/gitweb/?p=koha.git;a=commit;h=1519497ea74339277b08a0eff66bc9e0b702b933