Either from OPAC and Intranet, while exporting lists with formats "MARC" (OPAC) / "Iso2709" (on Intranet; different name to same thing) the downloaded file named "shelf.iso2709" is on latin1 instead of utf8, never reporting this, and also it seems very buggy: $ yaz-marcdump -f latin1 -t utf8 -i marc -o line "shelf.iso2709" | head -n30 [...] 245 00 $a Introducción general a la informática : $b periféricos y redes locales / $c Mario Carlos Ginzburg; ilustrado por Rafael Ginzburg (Separator but not at end of field length=134) 250 a4 $ ed. (Separator but not at end of field length=11) 260 aB $e nos Aires : $b Mario Carlos Ginzburg, $c 2006 (Separator but not at end of field length=51)
Selecting 8859-1 (latin1) while staging records for import doesn't fix the issue. A workaround was to: yaz-iconv -f latin1 -t utf8 shelf.iso2709 > shelf.iso2709-utf This "fix" the file and then yaz-marcdump shelf.iso2709-utf gives the expected output.
Pablo, could you please test it again against the master branch? Some recent fixes related to the export and encoding have been pushed.
Still there, Koha 3.18.06.000: $ yaz-marcdump shelf.iso2709 [ugly thing with � and «(Separator but not at end of field...»] $ yaz-iconv -f latin1 -t utf8 shelf.iso2709 > shelf.iso2709-utf $ yaz-marcdump shelf.iso2709-utf [Quod erat demonstrandum :P Expected result]
Pablo, Bug 11944 has been pushed to master and will be in Koha 3.20. I can confirm you this bug is fixed on the master branch (tested right now). I don't plan to provide patches for encoding related issues on the branches without patches from bug 11944.
Hi Jonathan! The bug is still there in master. Now I'm using 3.20.03.000 and the I can see the record looks good on Koha, but exporting the problem is still there. You can look at it with the procedure of comment 3.
I don't understand how you export your records. I don't manage to get a file with a .iso2709 extension.
- Search for books on intranet. - Clic on Add to and save them on a list. - Go to Home › Lists › Your lists - Clic on the list you just create - Clic on Download list and select "iso2709" - Save the "shelf.iso2709" file. - On terminal, follow steps on comment 3 NOTE: An ISO2709 is *almost* the same as a "MARC file". A mrc is an iso2709 that also have some other properties, like always subfields on tags>010. To avoid confusions maybe here template should say "MARC file" and filename should be: «list-<valid_name_of_list_name_for_filename>.mrc».
Just created bug 14786 about this terminological issues.
Looks good here: 200 1 $a Une Fêteກ ຂ ຄ ງ ຈ ຊ ຍ monstre <test2> test3 $f Stéphanie Laslett $g ill. Nigel MacMullen $b LIVR $é éééééééééééééééééééééééééé $ñ ññññññññññññññññññññññññññ
% yaz-iconv -f latin1 -t utf8 shelf.iso2709 > shelf.iso2709-utf % yaz-marcdump shelf.iso2709-utf | grep 200 200 1 $a Une Fêteຠຠຠຠຠຠຠmonstre <test2> test3 $f Stéphanie Laslett $g ill. Nigel MacMullen $b LIVR $à ©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©Ã©
tested on master and 3.20.02
Well, not in my case. I tried on different Kohas, all using MARC 21. Maybe (I don't think so) have something to do with the fact that my records have newlines in it. Bug 11388. More tests: First on MySQL directly: <datafield tag="245" ind1="0" ind2="0"> <subfield code="a">Química : </subfield> $ yaz-marcdump bib-2087.utf8 bib-13459.utf8 | grep "^245" 245 00 $a Química : $b una ciencia experimental / [...] 245 00 $a Estudio experimental de dispersión de [...] $ yaz-marcdump shelf.iso2709 | grep "^245" 245 00 $a Qu�mica : $b una ciencia experimental / [...] [Notice here second record is missing. If my list have only one record above command throw no output.] $ yaz-iconv -f latin1 -t utf8 shelf.iso2709 > shelf.iso2709-utf $ yaz-marcdump shelf.iso2709-utf | grep "^245" 245 00 $a Química : $b una ciencia experimental / [...] 245 00 $a Estudio experimental de dispersión de [...]
Could you attach the file here?
Created attachment 42528 [details] Exported list to buggy ISO2709 (~MARC file)
I got several (Separator but not at end of field length=96) Not sure it's normal. % yaz-marcdump shelf.iso | grep "^245" 245 00 $a Física / $c Paul A. Tipler $n [volumen 2] Where does the record come from? Manually cataloged into Koha? z3950 import? How does look the record using the MARC preview (detail page, link MARC Preview: Show)?
This sounds a bit like bug 17842 - I realize we only fixed that for the cart there and no mention of lists. If the bug is still present on lists, it might provide some insight.