The underlying bug is as much in the sip2 specification and implementation as in Koha, Symptom text in a sip request or response with a non-ascii character causes "undefined" behaviour in the client. (Usually an error and reset) Cause: The standard specifies that the sip character set is defined by an old dos codepage. I know of no client implementation which adheres to this most use a windows characterset. In Koha we send the text as retrieved from the database (i.e. utf-8) this is ok if the client is utf-8 or data is purely anglophone lacking special characters and diacritics. For some client devices we need a mechanism to protect them from scary non-ascii characters or to present them in a form they can display. In general the suppliers of client devices are a bit reticent about their machines character set limitations. This enhancement will probably be addressed when we have a case who want it fixed. This bug has been reported before but was closed without this specific problem being addressed
NEKLS is having this problem now, and a RFP is probably forthcoming to address it.
Created attachment 3175 [details] [review] Proposed fix
we are using just $msg = encode('utf-8', $msg); together with local $/ = "\x0d"; to send out data correctly to 3M stack which is some Java stuff installed on Windows. This two changes allowed us to see accented characters correctly on self-checks, and it's developed using 3M SIP 2.00 Emulator Version 1.3.0.1 I would suggest to add configuration option which can have default to clean output but also support sending correct utf-8 to clients which support it.
This bug is mentioned in: Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013882.html Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013884.html Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013886.html Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013888.html Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013891.html Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013892.html Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013894.html Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013896.html Bug 4828: Clean diacritics from SIP-written messages http://lists.koha-community.org/pipermail/koha-patches/2011-February/013887.html
*** This bug has been marked as a duplicate of bug 6765 ***