| Summary: | Allow MARC record importer to handle large batches without causing memory issues | ||
|---|---|---|---|
| Product: | Koha | Reporter: | Kyle M Hall (khall) <kyle> |
| Component: | Architecture, internals, and plumbing | Assignee: | Kyle M Hall (khall) <kyle> |
| Status: | NEW --- | QA Contact: | Testopia <testopia> |
| Severity: | enhancement | ||
| Priority: | P5 - low | CC: | nick |
| Version: | unspecified | ||
| Hardware: | All | ||
| OS: | All | ||
| GIT URL: | Initiative type: | --- | |
| Sponsorship status: | --- | Crowdfunding goal: | 0 |
| Patch complexity: | --- | Documentation contact: | |
| Documentation submission: | Text to go in the release notes: | ||
| Version(s) released in: | Circulation function: | ||
| Attachments: | Bug 23766: Upate RecordsFromISO2709File and RecordsFromMARCXMLFile to accept an offset and count | ||
|
Description
Kyle M Hall (khall)
2019-10-07 14:49:12 UTC
Created attachment 93826 [details] [review] Bug 23766: Upate RecordsFromISO2709File and RecordsFromMARCXMLFile to accept an offset and count When looking at this I wondered if instead of the RecordsFromISO2709File/RecordsFromMARCXMLFile looping the entire file we could loop in the script and pass each record to the subs, changing them to convert a single record, then have the script process the records in chunks, that way we don't need to handle offsets Was this solved by using the background jobs? |