Bug 36851 - Enhance Elasticsearch author, author as phrase MARC21 index mappings
Summary: Enhance Elasticsearch author, author as phrase MARC21 index mappings
Status: In Discussion
Alias: None
Product: Koha
Classification: Unclassified
Component: Searching - Elasticsearch (show other bugs)
Version: unspecified
Hardware: All All
: P5 - low enhancement
Assignee: Wainui Witika-Park
QA Contact: Thomas Klausner
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-05-13 23:28 UTC by Aleisha Amohia
Modified: 2024-07-17 00:02 UTC (History)
4 users (show)

See Also:
Change sponsored?: Sponsored
Patch complexity: ---
Documentation contact:
Documentation submission:
Text to go in the release notes:
Version(s) released in:
Circulation function:


Attachments
Bug 36851: Enhance Elasticsearch author, author as phrase MARC21 index mappings (1.79 KB, patch)
2024-05-30 01:04 UTC, Wainui Witika-Park
Details | Diff | Splinter Review
Bug 36851: Enhance Elasticsearch author, author as phrase MARC21 index mappings (1.84 KB, patch)
2024-05-31 01:03 UTC, David Nind
Details | Diff | Splinter Review
Bug 36851: Enhance Elasticsearch author, author as phrase MARC21 index mappings (1.88 KB, patch)
2024-07-16 20:09 UTC, Thomas Klausner
Details | Diff | Splinter Review

Note You need to log in before you can comment on or make changes to this bug.
Description Aleisha Amohia 2024-05-13 23:28:05 UTC
We would like to add the following tags and subfields to the existing author index for Elasticsearch MARC21, as used by the "author" and "author as phrase" advanced search dropdown options:

* 100abc (currently 100a)
* 700abc (currently 700a)
* 250b (currently not mapped)
* 800abc (currently not mapped)
* 810ab (currently not mapped)

Explanation to justify these mappings:

* To search main/added entry personal name (100/700) for numeration ($b), titles and words associated with a name ($c).
e.g. 100 $a John Paul $b II $c Pope.
e.g. 700 $a John Paul $b II $c Pope.

To search edition statement (250), statement of responsibility ($b).
e.g. 250 $a Fourth edition / $b revised by J.G. Le Mesurier.

To search series added entry, personal name (800 $a), numeration ($b), and titles and words associated with a name ($c).
e.g. 800 $a Mackall, Dandi Daley.

To search series added entry, corporate name (810 $a) and subordinate unit ($b).
e.g.810 $a United States $b Army Map Service.
Comment 1 Wainui Witika-Park 2024-05-30 01:04:27 UTC
Created attachment 167250 [details] [review]
Bug 36851: Enhance Elasticsearch author, author as phrase MARC21 index mappings

Add the following tags and subfields to the existing author index for Elasticsearch MARC21, as used by the "author" and "author as phrase" advanced search dropdown options: 100abc (currently 100a), 700abc (currently 700a), 250b, 800abc, 810ab

Sponsored-by: Educational Services Australia SCIS
Comment 2 David Nind 2024-05-31 01:03:21 UTC
Created attachment 167298 [details] [review]
Bug 36851: Enhance Elasticsearch author, author as phrase MARC21 index mappings

Add the following tags and subfields to the existing author index for Elasticsearch MARC21, as used by the "author" and "author as phrase" advanced search dropdown options: 100abc (currently 100a), 700abc (currently 700a), 250b, 800abc, 810ab

Sponsored-by: Educational Services Australia SCIS
Signed-off-by: David Nind <david@davidnind.com>
Comment 3 David Nind 2024-05-31 01:05:56 UTC
Testing notes using KTD:

1. Start up KTD with Elasticsearch: ktd --es8 up

2. Edit a record and add unique values as follows (I edited Programming Perl, 262):
   . 100 $a John Paul $b IV $c Pope  
   . 700 $a Divad $b 10 $c Photographer
   . 250 $b revised by J.G. Le Mesurier.
   . 800* $a Mackall, Dandi Daley. $b XIX $c Prince 
   . 810* $a New Zealand $b Department of Conservation.
   * Need to edit BKS framework to make these subfields visible in the editor for KTD)
   Mappings after and before patch:
   * 100abc (currently 100a)
   * 700abc (currently 700a)
   * 250b (currently not mapped)
   * 800abc (currently not mapped)
   * 810ab (currently not mapped)

3. Do a search for the terms in each subfield using the 'Author' and 'Author as a phrase' indexes in the staff interface advanced search.
   ==> Result: Should get a result when using values in the subfields that are mapped, but no result where the subfields are not mapped.

4. Apply this patch and restart all services (restart_all).

5. Reset the mappings: Administration > Catalog > Search engine configuration (Elasticsearch) > Reset mappings (at the bottom of the page)

6. Reindex: koha-elasticsearch --rebuild -d -b -a kohadev

7. Alternative to steps 5 and 6: reset_all then repeat step 2

8. Repeat step 3
   ==> Result: Should now get a result when using values in the subfields that are now mapped (and that weren't previously).
Comment 4 Thomas Klausner 2024-07-16 20:09:30 UTC
Created attachment 169068 [details] [review]
Bug 36851: Enhance Elasticsearch author, author as phrase MARC21 index mappings

Add the following tags and subfields to the existing author index for Elasticsearch MARC21, as used by the "author" and "author as phrase" advanced search dropdown options: 100abc (currently 100a), 700abc (currently 700a), 250b, 800abc, 810ab

Sponsored-by: Educational Services Australia SCIS
Signed-off-by: David Nind <david@davidnind.com>
Signed-off-by: Thomas Klausner <domm@plix.at>
Comment 5 David Cook 2024-07-17 00:02:15 UTC
Same issue as bug 36850