Bug 15464 - Fast Cataloguing gateway timeout
Summary: Fast Cataloguing gateway timeout
Status: CLOSED FIXED
Alias: None
Product: Koha
Classification: Unclassified
Component: Cataloging (show other bugs)
Version: 3.22
Hardware: PC Linux
: P5 - low normal (vote)
Assignee: Galen Charlton
QA Contact: Testopia
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-01-05 00:12 UTC by Patfrat
Modified: 2018-12-03 20:04 UTC (History)
3 users (show)

See Also:
Change sponsored?: ---
Patch complexity: ---
Documentation contact:
Documentation submission:
Text to go in the release notes:
Version(s) released in:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Patfrat 2016-01-05 00:12:41 UTC
Hello. And happy new year !

I am using Koha from debian packages v3.22.01 and i cannot add from fast cataloguing since the last update to this version. It results in a gateway timeout.

AH01220: Timeout waiting for output from CGI script /usr/share/koha/intranet/cgi-bin/cataloguing/addbiblio.pl, referer: http://.../cgi-bin/koha/cataloguing/addbiblio.pl?frameworkcode=FA

It's running on Ubuntu 14.04
apache2               2.4.7-1ubuntu4. i386
mysql-server          5.5.46-0ubuntu0 all

I don't know what's wrong since the last update.
Could you help me please ?

Thanks in advance
Comment 1 Jonathan Druart 2016-01-05 13:51:19 UTC
From which version did you update?
Comment 2 Patfrat 2016-01-06 00:26:03 UTC
I will try to see from wich version i update as soon as possible, when i retrieve the distant access to the computer concerned. It is shutdown at this moment.
Comment 3 Patfrat 2016-01-06 21:41:20 UTC
I have upgraded from a working koha-common version 3.20.03 to a non working version 3.22.0 and then 3.22.01 hoping that it would fix the bug but no ...
Comment 4 Patfrat 2016-01-06 23:53:02 UTC
I have also a bug when i try to save via default form cataloguing
Unsupported UNIMARC character encoding [] for XML output for UNIMARC; 100$a -> try at /usr/share/perl5/MARC/File/XML.pm line 568.

Is it reliable to my timeout post bug on fast cataloguing ?
Comment 5 Patfrat 2016-01-06 23:57:45 UTC
Z39.50/SRU importation is working
Manually adding via addbiblio.pl in default or Fast cataloguing not!
Comment 6 Patfrat 2016-01-07 01:14:31 UTC
Found at night !

Missing some perl modules : Test::DBIx::Class and HTTPD::Bench::ApacheBench
Perl modules to upgrade : Exception::class

Just a module to upgrade but failed behing my proxy : Test::WWW::Mechanize

So it seems it was a perl module issue !
Comment 7 Jonathan Druart 2016-01-07 08:47:37 UTC
(In reply to Patfrat from comment #6)
> Found at night !
> 
> Missing some perl modules : Test::DBIx::Class and HTTPD::Bench::ApacheBench
> Perl modules to upgrade : Exception::class
> 
> Just a module to upgrade but failed behing my proxy : Test::WWW::Mechanize
> 
> So it seems it was a perl module issue !

Did you note the versions of Exception::class before and after the upgrade?
Comment 8 Patfrat 2016-01-07 08:54:24 UTC
Exception::Class was v1.37 and upgraded to v1.39
Comment 9 Jonathan Druart 2016-01-07 09:48:13 UTC
It's the only one used from Koha, the others are for the tests.

But it seems weird that your problem came from this module.

Anyway, can we mark this bug as fixed?
Comment 10 Jonathan Druart 2016-01-07 09:49:54 UTC
(In reply to Patfrat from comment #4)
> I have also a bug when i try to save via default form cataloguing
> Unsupported UNIMARC character encoding [] for XML output for UNIMARC; 100$a
> -> try at /usr/share/perl5/MARC/File/XML.pm line 568.

This generally happens when you are using MARC21 records with the syspref marcflavour set to UNIMARC.
Comment 11 Patfrat 2016-01-07 09:54:45 UTC
Thanks for all your replies ! I am happy to have Koha working again !
You can mark this bug as fixed !
Comment 12 Patfrat 2016-01-08 00:22:38 UTC
It seems finally that the bug is there again
I have setted marcflavour to MARC1 to fix Unsupported UNIMARC character encoding error. So, now, i can use addbiblio with default grid but not yet with my fast cataloguing framework 

addbiblio.pl?frameworkcode=FA

that contains only these fields

Tab0: 099, 200, 205, 210, 225
Tab1: 000, 001, 100

No response from the server ...
AM i missing an important field ?
Comment 13 Patfrat 2016-01-08 00:34:33 UTC
I have done a dump from the distant computer and a restore to my own computer to be able to debug it at home.

I have already those error on my logs
Timeout waiting for output from CGI script /usr/share/koha/intranet/cgi-bin/cataloguing/addbiblio.pl
Script timed out before returning headers: addbiblio.pl

How can i know what happens ?
When i submit the form, addbiblio.pl script set my CPU to 100% ?!?
Comment 14 Patfrat 2016-01-08 00:54:52 UTC
Oh and the search does not work anymore, no results ...
Comment 15 Patfrat 2016-01-08 01:18:13 UTC
ok, the search works again if i a this to my koha-conf.xml file
<log4perl_conf>__KOHA_CONF_DIR__/log4perl.conf</log4perl_conf>

<!-- true type font mapping accoding to type from $font_types in C4/Creators/Lib.pm -->
 <ttf>
    <font type="TR" >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSerif.ttf</font>
    <font type="TB" >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSerif-Bold.ttf</font>
    <font type="TI" >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSerif-Italic.ttf</font>
    <font type="TBI">/usr/share/fonts/truetype/ttf-dejavu/DejaVuSerif-BoldItalic.ttf</font>
    <font type="C"  >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSansMono.ttf</font>
    <font type="CB" >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSansMono-Bold.ttf</font>
    <font type="CO" >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSansMono-Oblique.ttf</font>
    <font type="CBO">/usr/share/fonts/truetype/ttf-dejavu/DejaVuSansMono-BoldOblique.ttf</font>
    <font type="H"  >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSans.ttf</font>
    <font type="HO" >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSans-Oblique.ttf</font>
    <font type="HB" >/usr/share/fonts/truetype/ttf-dejavu/DejaVuSans-Bold.ttf</font>
    <font type="HBO">/usr/share/fonts/truetype/ttf-dejavu/DejaVuSans-BoldOblique.ttf</font>
 </ttf>
Comment 16 Patfrat 2016-01-08 08:37:28 UTC
And this error again
Unsupported UNIMARC character encoding [] for XML output for UNIMARC; 100$a -> try at /usr/share/perl5/MARC/File/XML.pm line 568.

If i set macflavour to MARC21, all my document's title are not visible
If i set macflvaour to UNIMARC, default value for my instance, titles are visible but this error appears for these items i have saved with addbiblio default grid !

I will try first to remove manually wrong items, then, trying to see what's wrong with addbiblio.pl overloading my CPU when i submit via Fast Add !
Comment 17 Patfrat 2016-01-08 12:33:37 UTC
I have modified this file /usr/share/perl5/MARC/File/XML.pm row 568 to not die and return UTF-8 instead to be allow to retrieve my test items and not throwing Unsupported UNIMARC character encoding [] for XML output for UNIMARC; 100$a -> try at /usr/share/perl5/MARC/File/XML.pm line 568.

Then i have deleted concerned items ... but i have always some bugs.

Fast cataloguing not working
Having some javascript files timeout (browser.js, basket.js)
And saving via default grid use MARC21 and not UNIMARC !!!
Comment 18 Patfrat 2016-01-08 23:26:05 UTC
After searching a lot, i have decided to delete my fast add unimarc framework.
I have also deleted two bad documents that zebra rebuild indocicates me with error on item numbers 1030, 1034

I have deleted them via mysql
Then, i have updated all biblio records setting frameworkcode to '' instead of FA

And now, it works !
But i have no more Fast Add framework !
DO you provide one for Unimarc in fr-FR language ?
Comment 19 Jonathan Druart 2016-01-11 10:36:46 UTC
(In reply to Patfrat from comment #18)
> But i have no more Fast Add framework !
> DO you provide one for Unimarc in fr-FR language ?

Sorry but I am a bit lost :)
I confirm that there is a FA framework for UNIMARC installations, and I am able to create a record using it without getting any error.
Comment 20 Patfrat 2016-01-11 10:46:10 UTC
After installing fresh version from debian repository with UNIMARC, no Fast Add was present for me ... but i have finally removed my Fast Add configuration and hidden a lot of fields in the default grid and all is working !

I will try to reinstall again Koha from debian package to see what could be wrong with FA !
Comment 21 Jonathan Druart 2016-01-11 10:57:58 UTC
(In reply to Patfrat from comment #20)
> After installing fresh version from debian repository with UNIMARC, no Fast
> Add was present for me ... but i have finally removed my Fast Add
> configuration and hidden a lot of fields in the default grid and all is
> working !
> 
> I will try to reinstall again Koha from debian package to see what could be
> wrong with FA !

Have a look at the Koha log files when the installer is injecting data in DB. Maybe there is something going wrong during this step.
Comment 22 Jonathan Druart 2016-03-08 12:15:21 UTC
Is it solved?
Comment 23 Patfrat 2016-03-08 12:27:59 UTC
I have not yet retried a fresh install.
I will try it soon
Comment 24 Jon Knight 2017-12-06 17:08:26 UTC
Can we assume this bug is fixed as there hasn't been any response on it for over a year now?
Comment 25 Patfrat 2017-12-08 08:24:54 UTC
Yes it can be closed