Bug 9342 - zebra UNIMARC dom indexing does not work
Summary: zebra UNIMARC dom indexing does not work
Status: CLOSED FIXED
Alias: None
Product: Koha
Classification: Unclassified
Component: Searching (show other bugs)
Version: Main
Hardware: All All
: P5 - low critical (vote)
Assignee: Galen Charlton
QA Contact:
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2013-01-03 15:01 UTC by Paul Poulain
Modified: 2019-06-27 09:24 UTC (History)
6 users (show)

See Also:
Change sponsored?: ---
Patch complexity: ---
Documentation contact:
Documentation submission:
Text to go in the release notes:
Version(s) released in:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Paul Poulain 2013-01-03 15:01:49 UTC
Testing bug 8984, I find that the UNIMARC dom indexing does not work.
Without patch 8984, a fresh install, with UNIMARC, DOM and CHR (not ICU) result in a bad:

15:28:48-03/01 zebraidx(25369) [warn] Unknown register type:

(and no indexing is made)
Comment 1 Mathieu Saby 2013-02-01 10:27:45 UTC
Hello
I have just tried with Unimarc and ICU. 
It seems to work.

M. Saby
Comment 2 Mathieu Saby 2013-03-27 15:53:50 UTC
Today, with ICU I also got the message "[warn] Unknown register type".
It does not break search.

I used rebuild_zebra with "-v -v" to get more information :

16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] Read character table sort-string-utf.chr
16:35:26-27/03 zebraidx(3050) 00d79db5 [log] add dom./home/msaby/koha/kohamaster/etc/zebradb/biblios/etc/dom-config.xml /tmp/El4x1XN4NL/biblio/exported_records 0
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort10 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort10 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort16 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort16 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort17 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort17 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort40 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort40 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort51 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort51 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort55 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort55 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort64 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort64 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort74 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort74 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] Using default resource threads:1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] key_block_create t=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [warn] Unknown register type: 
16:35:26-27/03 zebraidx(3050) 00d79db5 [log] add dom./home/msaby/koha/kohamaster/etc/zebradb/biblios/etc/dom-config.xml /tmp/El4x1XN4NL/biblio/exported_records 4100
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort97 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort97 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort101 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort101 bs=64, RW)
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] sort idx sort128 wr=1
16:35:26-27/03 zebraidx(3050) 00d79db5 [debug] mf_open(sort128 bs=64, RW)

I also note in the logs of zebrasrv -f $KOHA_CONF the following warns when I am doing a search or displaying a single record :
16:44:54-27/03 zebrasrv(3) [warn] Missing attribute 'type' in attribute info
16:44:54-27/03 zebrasrv(3) [warn] Missing attribute 'type' in attribute info
16:44:54-27/03 zebrasrv(3) [warn] Missing attribute 'type' in attribute info
16:44:54-27/03 zebrasrv(3) [warn] Missing attribute 'type' in attribute info
16:44:54-27/03 zebrasrv(3) [warn] Missing attribute 'type' in attribute info
16:44:54-27/03 zebrasrv(3) [warn] Missing attribute 'type' in attribute info

I did not have an index named "type"...
Maybe it could help ?

M. Saby
Comment 3 Mathieu Saby 2013-09-08 10:58:28 UTC
To test again when bug 7421 and bug 8252 are pushed.
M. Saby
Comment 4 Vitor Fernandes 2013-09-12 19:54:42 UTC
This error is easy to solve.
In record.abs, biblio-zebra-index.xsl and biblio-koha-index.xsl  the 995 field is mapped to "item # to index all subfields".
To stop that error just remove the commentary "# to index all subfields" on xsl files.

I have to more critical problems:

With barcode,phr or barcode,wrdl, I can search for barcodes. If there is only one barcode matching the search expression, the user is redirect to the record.

With callnum,phr or callnum,wrdl, I can search for callnumbers. If there is only one callnumber matching the search expression, the user is redirect to the record.

With kw,wrdl (keyword - any field), I get always 0 records when searching for one barcode or callnum that I know that exists.
Comment 5 Mathieu Saby 2013-09-12 21:03:19 UTC
Hello 
This is a duplicate of this bug
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10037

I made a patch for the 1st pbm. You can test it if you want.

M. Saby
Comment 6 Mathieu Saby 2013-09-12 21:05:53 UTC
Maybe this patch could help too, but I am not sure
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9830

M. Saby
Comment 7 Tomás Cohen Arazi 2014-10-28 21:16:46 UTC
Is it possible that we verify the error persists and write down the steps to reproduce it?
Comment 8 Katrin Fischer 2014-11-03 22:46:32 UTC
Is DOM indexing for UNIMARC still not functional at all, as the title of this bug suggests or is there a more specific problem?
Comment 9 Jonathan Druart 2014-11-20 14:46:17 UTC
This seems to be fixed.
I installed Koha using the debian packages.
On a UNIMARC installation, indexing in dom.

# koha-rebuild-zebra -b -v -f koha-test
Zebra configuration information
================================
Zebra biblio directory      = /var/lib/koha/koha-test/biblios
Zebra authorities directory = /var/lib/koha/koha-test/authorities
Koha directory              = /usr/share/koha/intranet/cgi-bin
Lockfile                    = /var/lock/koha/koha-test/rebuild/rebuild..LCK
BIBLIONUMBER in :     001$@
BIBLIOITEMNUMBER in : 090$a
================================
skipping authorities
====================
exporting biblio
====================
4801....................................................................................................
Records exported: 4848
====================
REINDEXING zebra
====================
====================
CLEANING
====================