Bug 10518

Summary: Add sorting for Cyrillic characters
Product: Koha Reporter: Tigran <tigran>
Component: Searching - ZebraAssignee: Galen Charlton <gmcharlt>
Status: RESOLVED FIXED QA Contact:
Severity: enhancement    
Priority: P5 - low CC: dcook, katrin.fischer
Version: Main   
Hardware: All   
OS: All   
See Also: http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11927
Change sponsored?: --- Patch complexity: ---
Documentation contact: Documentation submission:
Text to go in the release notes:
Version(s) released in:
Attachments: After activating the option 'Relevance'->'Title A-Z' Armenian and Cyrillic records are mixed.

Description Tigran 2013-06-30 11:56:24 UTC
In Koha system (versions 3.08, 3.10, 3.12) for multi script records (e.g. titles are in Latin, in Cyrillic, in Armenian)after search, when from relevance drop down menu selecting 'Title (A-Z)' the display for non-Latin records is not in correct order. If for Latin records they are displayed in correct alphabetical order, Armenian and Cyrillic records are mixed, between the records with Armenian titles starting with the letter 'A' you can see records for which the title is starting with the letters 'M', 'H', then again 'A', then Cyrillic records are coming, and after those again records with Armenian letters.
Is this a Zebra problem?
Any ideas?
thanks
Tigran
Comment 1 Tigran 2013-06-30 12:04:24 UTC
Created attachment 19297 [details]
After activating the option 'Relevance'->'Title A-Z' Armenian and Cyrillic records are mixed.
Comment 2 Katrin Fischer 2015-01-06 20:56:49 UTC
I think Zebra uses a file to know how to sort - currently we probably don't have one for multiple scripts, bug 11927 could give some hints.
Comment 3 Katrin Fischer 2020-01-05 10:20:41 UTC
Problem here is not relevance but alphabetic sorting, changing the bug title to reflect this.
Comment 4 David Cook 2022-12-06 01:32:19 UTC
This arguably could be a support ticket since not enough information has been given on Zebra configuration...
Comment 5 Katrin Fischer 2022-12-06 23:45:21 UTC
(In reply to David Cook from comment #4)
> This arguably could be a support ticket since not enough information has
> been given on Zebra configuration...

The problem is that the sort config files are language specific and you have to decide on 'one of them'. If you have multi-language items, this is not ideal:

https://git.koha-community.org/Koha-community/Koha/src/branch/master/etc/zebradb/lang_defs

There are now files for ru and ua - so this could be solved by changing the Zebra config to use one of them maybe.
Comment 6 David Cook 2022-12-07 00:15:26 UTC
Is this just a CHR problem? Or does it also affect ICU?

Multiple languages are always tricky...
Comment 7 Katrin Fischer 2022-12-07 00:25:29 UTC
I believe ICU as well. I think I once created a merged file for us that included Greek and other alphabets to fix some issues reported by a library using ICU.
Comment 8 Katrin Fischer 2023-07-08 16:22:47 UTC
I believe this was fixed by the addition of sort files for ru and ua:
https://git.koha-community.org/Koha-community/Koha/src/branch/master/etc/zebradb/lang_defs

But it might still be worth thinking about a combined file for multi-language libraries? The approach of having them all in separate files and having to decide on just one appears to be flawed.