Bug 29087

Summary: Holds to pull list can crash with a SQL::Abstract puke
Product: Koha Reporter: Galen Charlton <gmcharlt>
Component: Hold requestsAssignee: Bugs List <koha-bugs>
Status: Needs Signoff --- QA Contact: Testopia <testopia>
Severity: major    
Priority: P5 - low CC: ajohnson, andrewfh, david.roberts, david, dcook, dpk, gmcharlt, jonathan.druart, kyle, martin.renvoize, matt.blenkinsop, nick, wizzyrea
Version: Main   
Hardware: All   
OS: All   
See Also: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=30155
Change sponsored?: --- Patch complexity: ---
Documentation contact: Documentation submission:
Text to go in the release notes:
Version(s) released in:
Bug Depends on: 3142    
Bug Blocks:    
Attachments: Bug 29087: Prevent filter_by_for_hold to crash if default holdallowed is not_allowed
Bug 29087: Add unit tests

Description Galen Charlton 2021-09-22 21:16:14 UTC
Opening the holds to pull list page can crash with the following logged error:

  SQL::Abstract::puke(): [SQL::Abstract::__ANON__] Fatal: SQL::Abstract before v1.75 used to generate incorrect SQL when the -NOT IN operator was given an undef-containing list: !!!AUDIT YOUR CODE AND DATA!!! (the upcoming Data::Query-based version of SQL::Abstract will emit the logically correct SQL instead of raising this exception) at /usr/share/koha/lib/Koha/Objects.pm line 145

I've traced this to Koha::Holds->get_items_that_can_fill(). Among other things, this routine fetches a list of item types that cannot fill holds, i.e., cases where the 'holdallowed' rule value is 'not_allowed'.

However, if your default rule is to not allow holds, the @hold_not_allowed_itypes list will end up including an entry whose value is undef. When passed to the item query, doing the -not_in filter on itype will result in the crash listed above.

A quick fix might be to filter out undef from that list. That will fix the crash, but could lead to incorrect results if the default policy is to deny holds for all item types except for ones that are going to be specifically permitted.
Comment 1 Jonathan Druart 2021-11-19 12:28:00 UTC
Created attachment 127859 [details] [review]
Bug 29087: Prevent filter_by_for_hold to crash if default holdallowed is not_allowed
Comment 2 Jonathan Druart 2021-11-19 12:29:01 UTC
This seems to be the way to go, but I don't think it's ready for integration. We should have the logic moved to Koha::ItemTypes and add test coverage. Will try and come back to this later.
Comment 3 Jonathan Druart 2021-11-19 12:31:02 UTC
Galen, thanks for reporting this bug!
Are you seeing this in master or stable?
Comment 4 Ashley Johnson 2021-12-23 01:05:43 UTC
Our library system is seeing this bug as well. Had a lot of staff reporting the error message to me today.
Comment 5 Liz Rea 2022-03-25 17:53:13 UTC
We have some libraries seeing this now as well, the rule mentioned here doesn't seem to be the culprit, but the error is the same.
Comment 6 Jonathan Druart 2022-03-25 18:42:38 UTC
Which version? Did you try the patch?
Comment 7 David Roberts 2022-10-21 02:21:53 UTC
I've tried patching a customer site with this and it works OK. Happy to sign off (even though the bug isn't requesting it yet....)
Comment 8 Katrin Fischer 2023-06-24 18:21:14 UTC
Should we move this to NSO or SO even?
Comment 9 Martin Renvoize 2023-09-19 15:29:40 UTC
We see this occasionally on customer sites too.. we've even got it backported in a couple of cases I think.
Comment 10 Jonathan Druart 2023-09-20 07:13:12 UTC
(In reply to Katrin Fischer from comment #8)
> Should we move this to NSO or SO even?

No, see comment 2.
Comment 11 Matt Blenkinsop 2024-04-16 13:25:03 UTC
Created attachment 164936 [details] [review]
Bug 29087: Add unit tests

prove t/db_dependent/Koha/Items.t
Comment 12 Matt Blenkinsop 2024-04-16 13:27:09 UTC
We're seeing this again on customer sites. Looking at the patch attached I'm not sure the code belongs in ItemTypes as the error is coming from the default circulation rules at its root. I've had a go at some unit tests for the patch Joubu did earlier. Would be good to get this resolved and pushed
Comment 13 David Nind 2024-04-29 09:53:53 UTC
Not sure from the comments if this is ready for sign off, or if more discussion is required.