In order to coordinate some developments on this subject, I will add some bug reports here and *try* to plan getting them further.
*** Bug 3343 has been marked as a duplicate of this bug. ***
*** Bug 16802 has been marked as a duplicate of this bug. ***
*** Bug 14583 has been marked as a duplicate of this bug. ***
*** Bug 13760 has been marked as a duplicate of this bug. ***
This subject is touched in many reports and we have a lot of duplicated code. The solutions under 5572/11315/11700 are more comprehensive and make merge behavior pref controlled. Somehow we need to *merge* the best of code from 11315, 11700 and 5572 in order to get further. I would suggest to copy tests from 11315/11700 and my own extended test originally aimed for 9988 to report 17909 as a starting point to verify the current merge routine. On that we should build the core changes from 5572/11315/11700. (Include the the $field->replace fix from 5572.) My suggestion for the pref name is AuthorityMergeMode btw. I checked the following reports and propose the following order to get some progress: [CLOSED] 03343 Duplicates [CLOSED] 05821 Enable cron job [CLOSED] 16802 Clearing subfields [CLOSED] 12791 dontmerge is confusing [CLOSED] 14583 Deleting subfields [CLOSED] 13760 What about two 700s linking to the same authority [START] 17909 Add tests for authority merge [PHASE2] 05572 Improve C4::AuthoritiesMarc->merge() + syspref AuthCleanBiblios [PHASE2] 11315 Subfield deletion (overwriteSubfieldsOnMerge) [PHASE2] 11700 C4::AuthoritiesMarc::merge enhancements/fixes [PHASE3] 14769 Correct indicators in merge [PHASE4/BLOCKED] 16018 Not properly merged (authorities/merge.pl) [PHASE5] 09988 AuthorityMergeLimit (instead of dontmerge) [PHASE6] 14026 Deleting an authority Did I forget a report, or would you suggest a different order, please tell.
(In reply to Marcel de Rooy from comment #5) Sounds reasonable, I'll be happy to test and sign off. Thanks for your attention!
Commented on bug 13760 about multiple links to same authority in one record.
Stage 1 is ready to go. Bug 17909 is ready for signoff. Merges tests from 11315 and 11700. Hope to get stage 2 further later this week.
A closer look at bug 14769 revealed that we should move it further in the line of work. We actually need framework default indicators first to address merges crossing the authtype border correctly.
Stage 2 is ready for signoff too. Look at bug 17913. The patches allow you to read all specific fixes easily. Some ideas going back to 2011 revived. We still need to look at: [PHASE3/BLOCKED] 16018 Not properly merged (authorities/merge.pl) [PHASE4] 09988 AuthorityMergeLimit (instead of dontmerge) [PHASE5] 14026 Deleting an authority [PHASE6/DEPENDS ON 9701] 14769 Correct indicators in merge In phase4 some things might be Koha-Objectified. Before moving further, I need your support in test and QA. As soon as we hit the PQA queue, I plan to continue. Thanks !
Bug 17909 and 17913 moved to PQA now with thanks to Josef and Julian! I added a intermediate report for the Merge.t test after a quick fix for UNIMARC field 100. That is bug 17950.
Stage 3 is on its way. Can we get these three reports further this week or so? BUG 17950: Tiny improvements on Merge.t BUG 17980: Fixing ModZebra calls in AuthoritiesMarc BUG 16018: Merge.pl does not update biblios linked to the old authority The third one is the most interesting fix in this stage, originating from Remi Marchand. Thanks! What remains is: [PHASE4] 09988 AuthorityMergeLimit (instead of dontmerge) [PHASE5] 14026 Deleting an authority [PHASE6/DEPENDS ON 9701] 14769 Correct indicators in merge In phase4 some things might be Koha-Objectified. We might need one or two intermediate reports in stage 4 to pave the way.
I added report 18014 to solve the problem of reusing authid's after deleting the last record. (In that regard also adding 12722 for adjusting bulkmarcimport and 8579 for a maintenance script.) Status in the current stage is now: NSO Bug 17950: Tiny improvements on Merge.t NSO Bug 17980: Fixing ModZebra calls in AuthoritiesMarc NSO Bug 18014: Fix AddAuthority SO Bug 16018: Merge.pl does not update biblios linked to the old authority So please help by adding your signoff on those three OR QAing the last one !
Progress update: We have some reports waiting in PQA queue. Thanks Mark, Julian, Mehdi and Nick. Still open in this stage are: [NSO] Bug 17980: Fix ModZebra call in AuthoritiesMarc [NSO] Bug 18070: Support clean removal of authorities After these two, the stage should be ready for bug 9988 and friends.
*** Bug 18106 has been marked as a duplicate of this bug. ***
Update: Bug 18070 made its way to PQA (thx Josef and Julian). Submitted bug 9988 now. It is the enhancement that replaces dontmerge by a limit. This sounds easier than it was. The Zebra code in merge is removed. The cron job has been refactored, and is no longer optional. It also supports merges from one authority type to another (with a table revision). Should be the last patch in this omnibus that makes fundamental changes to merge, except for a small expected change of the field indicators. So: Please test ! What should still follow? Housekeeping: Bug 18149 Replace CountUsage calls (finish a refactoring started in 9988) Bug 18071 Maintenance script Bug 14769 Indicators Bug 12722 Bulkmarcimport ??
Progress update: Bug 18070 has been pushed. The next step is to refine the merge functionality in bug 9988. It is waiting for your signoff. Please help to get this further. Thanks!
Long time no see? Bug 9988 got pushed into 17.05 in the meantime. I submitted two new reports now: 18071 Maintenance script update_authorities: renumber, delete or merge auth records on the command line 18149 Replace CountUsage calls by Koha Object calls Have fun !
Although several authority issues on bug 17380 are outside the scope of this omnibus, I will include a patch on 17380 that still adds a refinement of sub merge. Therefore adding this report to the dependency list too.
One of the last steps in this omnibus is bug 14769. Ready for some attention from your part :) Be welcome! About biblio indicators controlled by authorities.
I am removing 12722 from the list here and close this omnibus now. Bug 14769 got pushed to 18.05; I consider it the last of this series.