Bug 20424 - New UNIMARC ZEBRA indexes according to last IFLA updates
Summary: New UNIMARC ZEBRA indexes according to last IFLA updates
Status: Needs Signoff
Alias: None
Product: Koha
Classification: Unclassified
Component: Searching - Zebra (show other bugs)
Version: Main
Hardware: All All
: P5 - low enhancement
Assignee: François Pichenot
QA Contact: Victor Grousset/tuxayo
URL:
Keywords:
: 11050 23737 (view as bug list)
Depends on: 18309 20434
Blocks: 23702
  Show dependency treegraph
 
Reported: 2018-03-15 14:14 UTC by François Pichenot
Modified: 2024-09-23 12:29 UTC (History)
10 users (show)

See Also:
Change sponsored?: ---
Patch complexity: Medium patch
Documentation contact:
Documentation submission:
Text to go in the release notes:
Version(s) released in:
Circulation function:


Attachments
bib1.att (11.24 KB, text/plain)
2019-10-04 10:05 UTC, Koha Team University Lyon 3
Details
biblio-koha-indexdefs.xml (65.40 KB, text/xml)
2019-10-04 10:05 UTC, Koha Team University Lyon 3
Details
ccl.properties (48.88 KB, text/plain)
2019-10-04 10:06 UTC, Koha Team University Lyon 3
Details
Bug 20424: Add new zebra indexes for the last IFLA updates (7.54 KB, patch)
2021-03-31 09:27 UTC, Julian Maurice
Details | Diff | Splinter Review
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates (9.85 KB, patch)
2021-03-31 14:11 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: provides biblio-zebra-indexdefs.xsl (24.26 KB, patch)
2021-03-31 14:11 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates (11.49 KB, patch)
2021-04-01 13:59 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: provides biblio-zebra-indexdefs.xsl (26.68 KB, patch)
2021-04-01 14:00 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: adds new indexes as availables in C4::Search (2.27 KB, patch)
2022-03-31 08:35 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: Add new zebra indexes for the last IFLA updates (7.54 KB, patch)
2022-04-01 07:26 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates (13.49 KB, patch)
2022-04-01 07:27 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: provides biblio-zebra-indexdefs.xsl (27.81 KB, patch)
2022-04-01 07:27 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: Add new zebra indexes for the last IFLA updates (7.59 KB, patch)
2022-04-01 08:32 UTC, Biblibre Sandboxes
Details | Diff | Splinter Review
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates (13.54 KB, patch)
2022-04-01 08:32 UTC, Biblibre Sandboxes
Details | Diff | Splinter Review
Bug 20424: provides biblio-zebra-indexdefs.xsl (27.78 KB, patch)
2022-04-01 08:32 UTC, Biblibre Sandboxes
Details | Diff | Splinter Review
Bug 20424: Add new zebra indexes for the last IFLA updates (7.57 KB, patch)
2023-03-28 14:11 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates (1.46 KB, patch)
2023-03-28 14:11 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: remove zebra index for field 901 (2.05 KB, patch)
2023-03-28 14:12 UTC, Alex Arnaud
Details | Diff | Splinter Review
Bug 20424: provides biblio-zebra-indexdefs.xsl (7.29 KB, patch)
2023-03-28 14:15 UTC, Alex Arnaud
Details | Diff | Splinter Review

Note You need to log in before you can comment on or make changes to this bug.
Description François Pichenot 2018-03-15 14:14:02 UTC
Zebra doesn't yet integrate last Unimarc bibliographic updates published by IFLA.
This ticket aims to update Zebra Unimarc bibliographic mappings.
Comment 1 Koha Team University Lyon 3 2019-10-04 10:02:07 UTC
*** Bug 23737 has been marked as a duplicate of this bug. ***
Comment 2 Koha Team University Lyon 3 2019-10-04 10:05:11 UTC
Created attachment 93732 [details]
bib1.att
Comment 3 Koha Team University Lyon 3 2019-10-04 10:05:46 UTC
Created attachment 93733 [details]
biblio-koha-indexdefs.xml
Comment 4 Koha Team University Lyon 3 2019-10-04 10:06:15 UTC
Created attachment 93736 [details]
ccl.properties
Comment 5 Koha Team University Lyon 3 2019-10-04 12:33:36 UTC
*** Bug 11050 has been marked as a duplicate of this bug. ***
Comment 6 Julian Maurice 2021-03-31 09:27:02 UTC
Created attachment 119034 [details] [review]
Bug 20424: Add new zebra indexes for the last IFLA updates
Comment 7 Julian Maurice 2021-03-31 09:27:28 UTC
Just turned the 3 attached files into a patch so that it's easier to apply
Comment 8 Alex Arnaud 2021-03-31 14:11:17 UTC
Created attachment 119053 [details] [review]
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates
Comment 9 Alex Arnaud 2021-03-31 14:11:26 UTC
Created attachment 119054 [details] [review]
Bug 20424: provides biblio-zebra-indexdefs.xsl
Comment 10 Alex Arnaud 2021-04-01 13:59:58 UTC
Created attachment 119080 [details] [review]
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates
Comment 11 Alex Arnaud 2021-04-01 14:00:06 UTC
Created attachment 119081 [details] [review]
Bug 20424: provides biblio-zebra-indexdefs.xsl
Comment 12 Koha Team University Lyon 3 2021-04-08 13:59:00 UTC
Thanks Alex for the new patches.
I'm testing right now and I'm wondering if we couldn't enhance the search on the new index : Identifier-persistent (on fields 003 and 033$a)
Is it normal that when I tried :
localhost:8080/cgi-bin/koha/opac-search.pl?advsearch=1&idx=Identifier-persistent&q=ARK%3A99

I found a biblio with :
033 : http://www.sudoc.fr/001018426
and
033$a=https://catalogue.bnf.fr/ark:/12148/cb34368226v
and
033$a=https://reseau-mirabel.info/revue/titre-id/9939

I was expecting to find a biblio with :
003 like ARK:99
or 033$a like ARK:99

Do you think we could change that ?

Thanks
Comment 13 Thibault Keromnès 2022-01-26 09:02:40 UTC
Hi Alex
We tested the patch last week, most of it works great, thanks. 
Only three indexes we couldn't use : 
- carrier-type
- identifier-persistent (we were not able to reproduce comment #12 search)
- char-encoding
I'm not sure if we had the syntax right (we used intranet search, with "Index-name:search", it worked for most, not for those 3) or if it's a problem with the patch.
Comment 14 Alex Arnaud 2022-03-31 08:35:49 UTC
Created attachment 132663 [details] [review]
Bug 20424: adds new indexes as availables in C4::Search
Comment 15 Koha Team University Lyon 3 2022-03-31 13:50:34 UTC
Hi,
We have just noticed that the char-encoding should'nt be indexed as number.
And that position 30 to 34 should be splitted: it's twice a 2 characters value.
So, we have this proposition for the xml file.


<index_subfields tag="100" subfields="a" offset="26" length="2">
    <target_index>char-encoding:w</target_index>	
    <target_index>char-encoding:p</target_index>	
 </index_subfields>
<index_subfields tag="100" subfields="a" offset="28" length="2">
    <target_index>char-encoding:w</target_index>	
    <target_index>char-encoding:p</target_index>	
 </index_subfields>
<index_subfields tag="100" subfields="a" offset="30" length="2">
    <target_index>char-encoding:w</target_index>	
    <target_index>char-encoding:p</target_index>	
 </index_subfields>
<index_subfields tag="100" subfields="a" offset="32" length="2">
    <target_index>char-encoding:w</target_index>	
    <target_index>char-encoding:p</target_index>	
 </index_subfields>

Sonia
Comment 16 Alex Arnaud 2022-04-01 07:26:50 UTC
Created attachment 132816 [details] [review]
Bug 20424: Add new zebra indexes for the last IFLA updates
Comment 17 Alex Arnaud 2022-04-01 07:27:20 UTC
Created attachment 132817 [details] [review]
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates
Comment 18 Alex Arnaud 2022-04-01 07:27:55 UTC
Created attachment 132818 [details] [review]
Bug 20424: provides biblio-zebra-indexdefs.xsl
Comment 19 Koha Team University Lyon 3 2022-04-01 08:26:24 UTC
Hi,
We tested it on a kohadevbox.
We tried all the indexes.
It works.
Thanks :-)
Sonia
Comment 20 Biblibre Sandboxes 2022-04-01 08:32:34 UTC
Created attachment 132827 [details] [review]
Bug 20424: Add new zebra indexes for the last IFLA updates

Signed-off-by: Sonia <sonia.bouis@univ-lyon3.fr>
Comment 21 Biblibre Sandboxes 2022-04-01 08:32:39 UTC
Created attachment 132828 [details] [review]
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates

Signed-off-by: Sonia <sonia.bouis@univ-lyon3.fr>
Comment 22 Biblibre Sandboxes 2022-04-01 08:32:43 UTC
Created attachment 132829 [details] [review]
Bug 20424: provides biblio-zebra-indexdefs.xsl

Signed-off-by: Sonia <sonia.bouis@univ-lyon3.fr>
Comment 23 Thibault Keromnès 2022-04-04 16:56:59 UTC
Does what it's supposed to do but we need to clarify a few changes in the code.
Comment 24 Victor Grousset/tuxayo 2022-04-07 16:14:09 UTC
field 901 wasn't in the IFLA updates. What is it's new index for?
Comment 25 Alex Arnaud 2023-03-28 14:11:47 UTC
Created attachment 148831 [details] [review]
Bug 20424: Add new zebra indexes for the last IFLA updates

Signed-off-by: Sonia <sonia.bouis@univ-lyon3.fr>
Comment 26 Alex Arnaud 2023-03-28 14:11:54 UTC
Created attachment 148832 [details] [review]
Bug 20424: (Followup) Add new zebra indexes for the last IFLA updates

Signed-off-by: Sonia <sonia.bouis@univ-lyon3.fr>
Comment 27 Alex Arnaud 2023-03-28 14:12:01 UTC
Created attachment 148833 [details] [review]
Bug 20424: remove zebra index for field 901
Comment 28 Alex Arnaud 2023-03-28 14:15:32 UTC
Created attachment 148834 [details] [review]
Bug 20424: provides biblio-zebra-indexdefs.xsl
Comment 29 David Nind 2024-03-16 22:34:22 UTC
I'd be happy to test, but I don't know enough about Zebra indexes to test.

If you could add a step-by-step test plan.
Comment 30 Mathieu Saby 2024-09-23 12:29:40 UTC
Hi
This should be reworked :
- Some points are now obsolete (219 field does not exist anymore)
- Too much changes in those patches I believe, and there should be summed up in commit description
- Changes related to 099 field are not linked to IFLA  updates, etc. Should be in a distinct bug
- for 099$o (opac supress), there is a more specific ticket : https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=37600
- No test plan

Not sure François Pichenot is still working on that. If needed I can take in charge the ticket