As described in Bug 9497 the encoding for BIBSYS should be ISO 8859-1. I'll check if other Norwegian sample servers need updating too.
Created attachment 15296 [details] [review] Bug 9498 - Update encoding for Norwegian sample Z39.50 servers The encoding for sample Z39.50 servers loaded when doing a nb-NO install has been wrong all along, resulting in "norwegian vowels" (æøå) being displayed as weird chars when records are fetched via Z39.50. This patch - Updates the sample servers installed by the web installer - Does a database upgrade that changes the encoding for the servers in question To test: - Do a Norwegian installation and make sure to choose the optional sample Z39.50 targets - Check that encodings for the Norwegian targets (BIBSYS, SAMBOK, NORBOK and DEICHMAN) are all set to ISO_6937 (which is the wrong encoding) - Apply this patch and make sure updatadatabase.pl is run - Check that the encoding for the four targets mentioned above are now ISO_8859-1 - Do one search against each target and check that there are no "strange" chars in the result list. Searching each of the targets for "hessen" should give results that include "norwegian vowels" - Log on to the MySQL of the test installation and empty the table of Z39.50 targets: mysql> delete from z3950servers; - Load this file into MySQL from the command line: installer/data/mysql/nb-NO/2-Valgfritt/z3950servers.sql and check that it loads without errors and that the four Norwegian targets are still set to have encoding = ISO_8859-1
Created attachment 15423 [details] [review] [SIGNED-OFF] Bug 9498 - Update encoding for Norwegian sample Z39.50 servers The encoding for sample Z39.50 servers loaded when doing a nb-NO install has been wrong all along, resulting in "norwegian vowels" (æøå) being displayed as weird chars when records are fetched via Z39.50. This patch - Updates the sample servers installed by the web installer - Does a database upgrade that changes the encoding for the servers in question To test: - Do a Norwegian installation and make sure to choose the optional sample Z39.50 targets - Check that encodings for the Norwegian targets (BIBSYS, SAMBOK, NORBOK and DEICHMAN) are all set to ISO_6937 (which is the wrong encoding) - Apply this patch and make sure updatadatabase.pl is run - Check that the encoding for the four targets mentioned above are now ISO_8859-1 - Do one search against each target and check that there are no "strange" chars in the result list. Searching each of the targets for "hessen" should give results that include "norwegian vowels" - Log on to the MySQL of the test installation and empty the table of Z39.50 targets: mysql> delete from z3950servers; - Load this file into MySQL from the command line: installer/data/mysql/nb-NO/2-Valgfritt/z3950servers.sql and check that it loads without errors and that the four Norwegian targets are still set to have encoding = ISO_8859-1 Signed-off-by: Bernardo Gonzalez Kriegel <bgkriegel@gmail.com> Comment: Work as described. No errors. Test: 1) NOTE: I didn't do a Norwegian install, only tested z39.50 servers output 2) Removed default z39 targets, installed norwegian ones 3) Checked previous z39.50 servers encoding 4) Pre-patch sample search "hessen" BIBSYS Hessen im Frþhmittelalter BIBSYS System der Gemeindebesteuerung in Hessen, Wþrttemberg, Baden, Elsa⅞-Lothringen, Bayern, Sachsen, Preu⅞en DEICHMAN De danske troppers h�derskrands. Eller det danske auxiliair-corps under anf. af prinds Frederik af Hessen NORBOK �tte-tavle for l�rer Johan P. Eidsvig og g�rdbr. Nikolai Nikolaisen Hessen SAMBOK ErlĦuterungen zur Geologischen Karte von Hessen 5) Applied patch, run updatedatabase 6) Checked sample servers encoding Ok 7) Post-patch sample search "hessen" BIBSYS Hessen im Frühmittelalter BIBSYS System der Gemeindebesteuerung in Hessen, Württemberg, Baden, Elsaß-Lothringen, Bayern, Sachsen, Preußen DEICHMAN De danske troppers hæderskrands. Eller det danske auxiliair-corps under anf. af prinds Frederik af Hessen NORBOK Ætte-tavle for lærer Johan P. Eidsvig og gårdbr. Nikolai Nikolaisen Hessen SAMBOK Erläuterungen zur Geologischen Karte von Hessen 8) Sample servers deleted and installed from command line, same result as 6) and 7) No koha-qa errors
QA Comment: Currently, you have encoding errors in the signed patch :) Could you resolve them please? Thanks. When you are looking again, I would suggest to narrow down the update statements when upgrading. Now you only check name=xxx. But I could have used this name unfortunately (may be bit fictitious).. If you add name=xxx and host=yyy, we are even more complete. Thanks.
(In reply to comment #3) > QA Comment: > Currently, you have encoding errors in the signed patch :) > Could you resolve them please? Could you tell me which ones? There are errors in the comment, but that was me showing the result before applying the patch. I could remove that comments if that's the problem :) Thanks
(In reply to comment #4) > (In reply to comment #3) > > QA Comment: > > Currently, you have encoding errors in the signed patch :) > > Could you resolve them please? > > Could you tell me which ones? There are errors in the comment, but that was > me showing the result before applying the patch. I could remove that > comments if that's the problem :) > > Thanks Maybe you could correct the patch manually (without git bz). Get rid also of the line Content-Transfer-Encoding: 8bit.
Created attachment 16904 [details] [review] [SIGNED-OFF] Bug 9498 - Update encoding for Norwegian sample Z39.50 servers Manually added patch. Removed strange vowels. Removed encoding line. May be now is well :)
(In reply to comment #6) > Created attachment 16904 [details] [review] [review] > [SIGNED-OFF] Bug 9498 - Update encoding for Norwegian sample Z39.50 servers > > Manually added patch. Removed strange vowels. Removed encoding line. > May be now is well :) Thanks!
Created attachment 16927 [details] [review] Bug 9498 QA Followup for updatedatabase Signed-off-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl>
Created attachment 16928 [details] [review] Bug 9498 QA Followup for updatedatabase Signed-off-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl>
Magnus, Could you confirm please if both Norwegian targets NORBOK and SAMBOK have the same host? Why add them both?
(In reply to comment #10) > Magnus, > Could you confirm please if both Norwegian targets NORBOK and SAMBOK have > the same host? Why add them both? They are two different databases ("catalogues") on the same host, so they give different results for the same search. Thanks for the followup whoch makes sense. Ill see if I can sign off on it soon.
(In reply to comment #11) > They are two different databases ("catalogues") on the same host, so they > give different results for the same search. > > Thanks for the followup whoch makes sense. Ill see if I can sign off on it > soon. That makes sense too. I try to have a look tomorrow and sign off on the small change myself if you do not beat me to it :)
Created attachment 16937 [details] [review] [SIGNED-OFF] Bug 9498 QA Followup for updatedatabase Signed-off-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl> Signed-off-by: Bernardo Gonzalez Kriegel <bgkriegel@gmail.com> Small followup to update servers. No errors
Created attachment 16939 [details] [review] Bug 9498 QA Followup for updatedatabase Signed-off-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl> Signed-off-by: Bernardo Gonzalez Kriegel <bgkriegel@gmail.com> Small followup to update servers. No errors
Created attachment 16940 [details] [review] Bug 9498 - Update encoding for Norwegian sample Z39.50 servers This patch - Updates the sample servers installed by the web installer - Does a database upgrade that changes the encoding for the servers in question To test: - Do a Norwegian installation and make sure to choose the optional sample Z39.50 targets - Check that encodings for the Norwegian targets (BIBSYS, SAMBOK, NORBOK and DEICHMAN) are all set to ISO_6937 (which is the wrong encoding) - Apply this patch and make sure updatadatabase.pl is run - Check that the encoding for the four targets mentioned above are now ISO_8859-1 - Do one search against each target and check that there are no "strange" chars in the result list. Searching each of the targets for "hessen" should give results that include "norwegian vowels" - Log on to the MySQL of the test installation and empty the table of Z39.50 targets: mysql> delete from z3950servers; - Load this file into MySQL from the command line: installer/data/mysql/nb-NO/2-Valgfritt/z3950servers.sql and check that it loads without errors and that the four Norwegian targets are still set to have encoding = ISO_8859-1 Signed-off-by: Bernardo Gonzalez Kriegel <bgkriegel@gmail.com> Comment: Work as described. No errors. No koha-qa errors Passed-QA-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl>
Created attachment 16941 [details] [review] Bug 9498 QA Followup for updatedatabase Signed-off-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl> Signed-off-by: Bernardo Gonzalez Kriegel <bgkriegel@gmail.com> Small followup to update servers. No errors
Thanks, Bernardo. No further comments necessary. Passed QA
This patch has been pushed to master.
Pushed to 3.10.x will be 3.10.5
Works as expected (tested with packages built off current master).