Attachment #110011 for bug #25067

View | Details | Raw Unified | Return to bug 25067
Collapse All | Expand All




# Internationalization

This page documents how internationalization works in Koha.

## Making strings translatable

There are several ways of making a string translatable, depending on where it
is located

### In Template::Toolkit files (`*.tt`)

The simplest way to make a string translatable in a template is to do nothing.
Templates are parsed as HTML files and almost all text nodes are considered as
translatable strings. This also includes some attributes like `title` and
`placeholder`.

This method has some downsides: you don't have full control over what would
appear in PO files and you cannot use plural forms or context. In order to do
that you have to use `i18n.inc`

`i18n.inc` contains several macros that, when used, make a string translatable.
The first thing to do is to make these macros available by adding

    [% PROCESS 'i18n.inc' %]

at the top of the template file. Then you can use those macros.

The simplest one is `t(msgid)`

    [% t('This is a translatable string') %]

You can also use variable substitution with `tx(msgid, vars)`

    [% tx('Hello, {name}', { name = 'World' }) %]

You can use plural forms with `tn(msgid, msgid_plural, count)`

    [% tn('a child', 'several children', number_of_children) %]

You can add context, to help translators when a term is ambiguous, with
`tp(msgctxt, msgid)`

    [% tp('verb', 'order') %]
    [% tp('noun', 'order') %]

Or any combinations of the above

    [% tnpx('bibliographic record', '{count} item', '{count} items', items_count, { count = items_count }) %]

### In JavaScript files (`*.js`)

Like in templates, you have several functions available. Just replace `t` by `__`.

    __('This is a translatable string');
    __npx('bibliographic record, '{count} item', '{count} items', items_count, { count: items_count });

### In Perl files (`*.pl`, `*.pm`)

You will have to add

    use Koha::I18N;

at the top of the file, and then the same functions as above will be available.

    __('This is a translatable string');
    __npx('bibliographic record, '{count} item', '{count} items', $items_count, count => $items_count);

### In installer and preferences YAML files (`*.yml`)

Nothing special to do here. All strings will be automatically translatable.

## Manipulating PO files

Once strings have been made translatable in source files, they have to be
extracted into PO files and uploaded on https://translate.koha-community.org/
so they can be translated.

### Install gulp first

The next sections rely on gulp. If it's not installed, run the following
commands:

    # as root
    npm install gulp-cli -g

    # as normal user, from the root of Koha repository
    yarn

### Create PO files for a new language

If you want to add translations for a new language, you have to create the
missing PO files. You can do that by executing the following command:

    # Replace xx-XX by your language tag
    gulp po:create --lang xx-XX

New PO files will be available in `misc/translator/po`.

### Update PO files with new strings

When new features or bugfixes are added to Koha, new translatable strings can
be added, other can be removed or modified, and the PO file become out of sync.

To be able to translate the new or modified strings, you have to update PO
files. This can be done by executing the following command:

    # Update PO files for all languages
    gulp po:update

    # or only one language
    gulp po:update --lang xx-XX

### Only extract strings

Creating or updating PO files automatically extract strings, but if for some
reasons you want to only extract strings without touching PO files, you can run
the following command:

    gulp po:extract

POT files will be available in `misc/translator`.

Lines 1-13 Link Here

(-)a/gulpfile.js (-1 / +292 lines)
1	/* eslint-env node */	1	/* eslint-env node */
2	/* eslint no-console:"off" */	2	/* eslint no-console:"off" */
3		3
4	const { dest, series, src, watch } = require('gulp');	4	const { dest, parallel, series, src, watch } = require('gulp');
		5
		6	const child_process = require('child_process');
		7	const fs = require('fs');
		8	const os = require('os');
		9	const path = require('path');
		10	const util = require('util');
5		11
6	const sass = require("gulp-sass");	12	const sass = require("gulp-sass");
7	const cssnano = require("gulp-cssnano");	13	const cssnano = require("gulp-cssnano");
8	const rtlcss = require('gulp-rtlcss');	14	const rtlcss = require('gulp-rtlcss');
9	const sourcemaps = require('gulp-sourcemaps');	15	const sourcemaps = require('gulp-sourcemaps');
10	const autoprefixer = require('gulp-autoprefixer');	16	const autoprefixer = require('gulp-autoprefixer');
		17	const concatPo = require('gulp-concat-po');
		18	const exec = require('gulp-exec');
		19	const merge = require('merge-stream');
		20	const through2 = require('through2');
		21	const Vinyl = require('vinyl');
11	const args = require('minimist')(process.argv.slice(2));	22	const args = require('minimist')(process.argv.slice(2));
12	const rename = require('gulp-rename');	23	const rename = require('gulp-rename');
13		24
Lines 62-69 function build() { Link Here
62	.pipe(dest(css_base));	73	.pipe(dest(css_base));
63	}	74	}
64		75
		76	const poTasks = {
		77	'marc-MARC21': {
		78	extract: po_extract_marc_marc21,
		79	create: po_create_marc_marc21,
		80	update: po_update_marc_marc21,
		81	},
		82	'marc-NORMARC': {
		83	extract: po_extract_marc_normarc,
		84	create: po_create_marc_normarc,
		85	update: po_update_marc_normarc,
		86	},
		87	'marc-UNIMARC': {
		88	extract: po_extract_marc_unimarc,
		89	create: po_create_marc_unimarc,
		90	update: po_update_marc_unimarc,
		91	},
		92	'staff-prog': {
		93	extract: po_extract_staff,
		94	create: po_create_staff,
		95	update: po_update_staff,
		96	},
		97	'opac-bootstrap': {
		98	extract: po_extract_opac,
		99	create: po_create_opac,
		100	update: po_update_opac,
		101	},
		102	'pref': {
		103	extract: po_extract_pref,
		104	create: po_create_pref,
		105	update: po_update_pref,
		106	},
		107	'messages': {
		108	extract: po_extract_messages,
		109	create: po_create_messages,
		110	update: po_update_messages,
		111	},
		112	'messages-js': {
		113	extract: po_extract_messages_js,
		114	create: po_create_messages_js,
		115	update: po_update_messages_js,
		116	},
		117	'installer': {
		118	extract: po_extract_installer,
		119	create: po_create_installer,
		120	update: po_update_installer,
		121	},
		122	'installer-MARC21': {
		123	extract: po_extract_installer_marc21,
		124	create: po_create_installer_marc21,
		125	update: po_update_installer_marc21,
		126	},
		127	};
		128
		129	const poTypes = Object.keys(poTasks);
		130
		131	function po_extract_marc (type) {
		132	return src(`koha-tmpl/-tmpl//en/*/${type}*`, { read: false, nocase: true })
		133	.pipe(xgettext('misc/translator/xgettext.pl --charset=UTF-8 -s', `Koha-marc-${type}.pot`))
		134	.pipe(dest('misc/translator'))
		135	}
		136
		137	function po_extract_marc_marc21 () { return po_extract_marc('MARC21') }
		138	function po_extract_marc_normarc () { return po_extract_marc('NORMARC') }
		139	function po_extract_marc_unimarc () { return po_extract_marc('UNIMARC') }
140
141	function po_extract_staff () {
142	const globs = [
143	'koha-tmpl/intranet-tmpl/prog/en/*/.tt',
144	'koha-tmpl/intranet-tmpl/prog/en/*/.inc',
145	'!koha-tmpl/intranet-tmpl/prog/en/*/MARC21*',
146	'!koha-tmpl/intranet-tmpl/prog/en/*/NORMARC*',
147	'!koha-tmpl/intranet-tmpl/prog/en/*/UNIMARC*',
148	];
149
150	return src(globs, { read: false, nocase: true })
151	.pipe(xgettext('misc/translator/xgettext.pl --charset=UTF-8 -s', 'Koha-staff-prog.pot'))
152	.pipe(dest('misc/translator'))
153	}
154
155	function po_extract_opac () {
156	const globs = [
157	'koha-tmpl/opac-tmpl/bootstrap/en/*/.tt',
158	'koha-tmpl/opac-tmpl/bootstrap/en/*/.inc',
159	'!koha-tmpl/opac-tmpl/bootstrap/en/*/MARC21*',
160	'!koha-tmpl/opac-tmpl/bootstrap/en/*/NORMARC*',
161	'!koha-tmpl/opac-tmpl/bootstrap/en/*/UNIMARC*',
162	];
163
164	return src(globs, { read: false, nocase: true })
165	.pipe(xgettext('misc/translator/xgettext.pl --charset=UTF-8 -s', 'Koha-opac-bootstrap.pot'))
166	.pipe(dest('misc/translator'))
167	}
168
169	const xgettext_options = '--from-code=UTF-8 --package-name Koha '
170	+ '--package-version= -k -k__ -k__x -k__n:1,2 -k__nx:1,2 -k__xn:1,2 '
171	+ '-k__p:1c,2 -k__px:1c,2 -k__np:1c,2,3 -k__npx:1c,2,3 -kN__ '
172	+ '-kN__n:1,2 -kN__p:1c,2 -kN__np:1c,2,3 --force-po';
173
174	function po_extract_messages_js () {
175	const globs = [
176	'koha-tmpl/intranet-tmpl/prog/js/*/.js',
177	'koha-tmpl/opac-tmpl/bootstrap/js/*/.js',
178	];
179
180	return src(globs, { read: false, nocase: true })
181	.pipe(xgettext(`xgettext -L JavaScript ${xgettext_options}`, 'Koha-messages-js.pot'))
182	.pipe(dest('misc/translator'))
183	}
184
185	function po_extract_messages () {
186	const perlStream = src(['*/.pl', '*/.pm'], { read: false, nocase: true })
187	.pipe(xgettext(`xgettext -L Perl ${xgettext_options}`, 'Koha-perl.pot'))
188
189	const ttStream = src([
190	'koha-tmpl/intranet-tmpl/prog/en/*/.tt',
191	'koha-tmpl/intranet-tmpl/prog/en/*/.inc',
192	'koha-tmpl/opac-tmpl/bootstrap/en/*/.tt',
193	'koha-tmpl/opac-tmpl/bootstrap/en/*/.inc',
194	], { read: false, nocase: true })
195	.pipe(xgettext('misc/translator/xgettext-tt2 --from-code=UTF-8', 'Koha-tt.pot'))
196
197	const headers = {
198	'Project-Id-Version': 'Koha',
199	'Content-Type': 'text/plain; charset=UTF-8',
200	};
201
202	return merge(perlStream, ttStream)
203	.pipe(concatPo('Koha-messages.pot', { headers }))
204	.pipe(dest('misc/translator'))
205	}
206
207	function po_extract_pref () {
208	return src('koha-tmpl/intranet-tmpl/prog/en/modules/admin/preferences/*.pref', { read: false })
209	.pipe(xgettext('misc/translator/xgettext-pref', 'Koha-pref.pot'))
210	.pipe(dest('misc/translator'))
211	}
212
213	function po_extract_installer () {
214	const globs = [
215	'installer/data/mysql/en/mandatory/*.yml',
216	'installer/data/mysql/en/optional/*.yml',
217	];
218
219	return src(globs, { read: false, nocase: true })
220	.pipe(xgettext('misc/translator/xgettext-installer', 'Koha-installer.pot'))
221	.pipe(dest('misc/translator'))
222	}
223
224	function po_extract_installer_marc (type) {
225	const globs = `installer/data/mysql/en/marcflavour/${type}/*/.yml`;
226
227	return src(globs, { read: false, nocase: true })
228	.pipe(xgettext('misc/translator/xgettext-installer', `Koha-installer-${type}.pot`))
229	.pipe(dest('misc/translator'))
230	}
231
232	function po_extract_installer_marc21 () { return po_extract_installer_marc('MARC21') }
233
234	function po_create_type (type) {
235	const access = util.promisify(fs.access);
236	const exec = util.promisify(child_process.exec);
237
238	const languages = getLanguages();
239	const promises = [];
240	for (const language of languages) {
241	const locale = language.split('-').filter(s => s.length !== 4).join('_');
242	const po = `misc/translator/po/${language}-${type}.po`;
243	const pot = `misc/translator/Koha-${type}.pot`;
244
245	const promise = access(po)
246	.catch(() => exec(`msginit -o ${po} -i ${pot} -l ${locale} --no-translator`))
247	promises.push(promise);
248	}
249
250	return Promise.all(promises);
251	}
252
253	function po_create_marc_marc21 () { return po_create_type('marc-MARC21') }
254	function po_create_marc_normarc () { return po_create_type('marc-NORMARC') }
255	function po_create_marc_unimarc () { return po_create_type('marc-UNIMARC') }
256	function po_create_staff () { return po_create_type('staff-prog') }
257	function po_create_opac () { return po_create_type('opac-bootstrap') }
258	function po_create_pref () { return po_create_type('pref') }
259	function po_create_messages () { return po_create_type('messages') }
260	function po_create_messages_js () { return po_create_type('messages-js') }
261	function po_create_installer () { return po_create_type('installer') }
262	function po_create_installer_marc21 () { return po_create_type('installer-MARC21') }
263
264	function po_update_type (type) {
265	const msgmerge_opts = '--backup=off --quiet --sort-output --update';
266	const cmd = `msgmerge ${msgmerge_opts} <%= file.path %> misc/translator/Koha-${type}.pot`;
267	const languages = getLanguages();
268	const globs = languages.map(language => `misc/translator/po/${language}-${type}.po`);
269
270	return src(globs)
271	.pipe(exec(cmd, { continueOnError: true }))
272	.pipe(exec.reporter({ err: false, stdout: false }))
273	}
274
275	function po_update_marc_marc21 () { return po_update_type('marc-MARC21') }
276	function po_update_marc_normarc () { return po_update_type('marc-NORMARC') }
277	function po_update_marc_unimarc () { return po_update_type('marc-UNIMARC') }
278	function po_update_staff () { return po_update_type('staff-prog') }
279	function po_update_opac () { return po_update_type('opac-bootstrap') }
280	function po_update_pref () { return po_update_type('pref') }
281	function po_update_messages () { return po_update_type('messages') }
282	function po_update_messages_js () { return po_update_type('messages-js') }
283	function po_update_installer () { return po_update_type('installer') }
284	function po_update_installer_marc21 () { return po_update_type('installer-MARC21') }
285
286	/**
287	* Gulp plugin that executes xgettext-like command `cmd` on all files given as
288	* input, and then outputs the result as a POT file named `filename`.
289	* `cmd` should accept -o and -f options
290	*/
291	function xgettext (cmd, filename) {
292	const filenames = [];
293
294	function transform (file, encoding, callback) {
295	filenames.push(path.relative(file.cwd, file.path));
296	callback();
297	}
298
299	function flush (callback) {
300	fs.mkdtemp(path.join(os.tmpdir(), 'koha-'), (err, folder) => {
301	const outputFilename = path.join(folder, filename);
302	const filesFilename = path.join(folder, 'files');
303	fs.writeFile(filesFilename, filenames.join(os.EOL), err => {
304	if (err) return callback(err);
305
306	const command = `${cmd} -o ${outputFilename} -f ${filesFilename}`;
307	child_process.exec(command, err => {
308	if (err) return callback(err);
309
310	fs.readFile(outputFilename, (err, data) => {
311	if (err) return callback(err);
312
313	const file = new Vinyl();
314	file.path = path.join(file.base, filename);
315	file.contents = data;
316	callback(null, file);
317	});
318	});
319	});
320	})
321	}
322
323	return through2.obj(transform, flush);
324	}
325
326	/**
327	* Return languages selected for PO-related tasks
328	*
329	* This can be either languages given on command-line with --lang option, or
330	* all the languages found in misc/translator/po otherwise
331	*/
332	function getLanguages () {
333	if (Array.isArray(args.lang)) {
334	return args.lang;
335	}
336
337	if (args.lang) {
338	return [args.lang];
339	}
340
341	const filenames = fs.readdirSync('misc/translator/po')
342	.filter(filename => filename.endsWith('.po'))
343	.filter(filename => !filename.startsWith('.'))
344
345	const re = new RegExp('-(' + poTypes.join('\|') + ')\.po$');
346	languages = filenames.map(filename => filename.replace(re, ''))
347
348	return Array.from(new Set(languages));
349	}
350
65	exports.build = build;	351	exports.build = build;
66	exports.css = css;	352	exports.css = css;
		353
		354	exports['po:create'] = parallel(...poTypes.map(type => series(poTasks[type].extract, poTasks[type].create)));
		355	exports['po:update'] = parallel(...poTypes.map(type => series(poTasks[type].extract, poTasks[type].update)));
		356	exports['po:extract'] = parallel(...poTypes.map(type => poTasks[type].extract));
		357
67	exports.default = function () {	358	exports.default = function () {
68	watch(css_base + "/src/*/.scss", series('css'));	359	watch(css_base + "/src/*/.scss", series('css'));
69	}	360	}




use C4::Context;
# WARNING: Any other tested YAML library fails to work properly in this
# script content
use YAML::Syck qw( LoadFile DumpFile );
use Locale::PO;
use FindBin qw( $Bin );
use File::Basename;
use File::Find;
use File::Path qw( make_path );
use File::Copy;
use File::Slurp;
use File::Spec;
use File::Temp qw( tempdir tempfile );
use Template::Parser;
use PPI;


$YAML::Syck::ImplicitTyping = 1;


# Default file header for .po syspref files
my $default_pref_po_header = Locale::PO->new(-msgid => '', -msgstr =>
    "Project-Id-Version: PACKAGE VERSION\\n" .
    "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\n" .
    "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\\n" .
    "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\\n" .
    "MIME-Version: 1.0\\n" .
    "Content-Type: text/plain; charset=UTF-8\\n" .
    "Content-Transfer-Encoding: 8bit\\n" .
    "Plural-Forms: nplurals=2; plural=(n > 1);\\n"
);


sub set_lang {
    my ($self, $lang) = @_;


                            "/prog/$lang/modules/admin/preferences";
}


sub new {
    my ($class, $lang, $pref_only, $verbose) = @_;


    $self->{verbose}         = $verbose;
    $self->{process}         = "$Bin/tmpl_process3.pl " . ($verbose ? '' : '-q');
    $self->{path_po}         = "$Bin/po";
    $self->{po}              = {};
    $self->{domain}          = 'Koha';
    $self->{cp}              = `which cp`;
    $self->{msgmerge}        = `which msgmerge`;
    $self->{msgfmt}          = `which msgfmt`;
    $self->{msginit}         = `which msginit`;
    $self->{msgattrib}       = `which msgattrib`;
    $self->{xgettext}        = `which xgettext`;
    $self->{sed}             = `which sed`;
    $self->{po2json}         = "$Bin/po2json";
    $self->{gzip}            = `which gzip`;
    $self->{gunzip}          = `which gunzip`;
    chomp $self->{cp};
    chomp $self->{msgmerge};
    chomp $self->{msgfmt};
    chomp $self->{msginit};
    chomp $self->{msgattrib};
    chomp $self->{xgettext};
    chomp $self->{sed};
    chomp $self->{gzip};
    chomp $self->{gunzip};

    unless ($self->{xgettext}) {
        die "Missing 'xgettext' executable. Have you installed the gettext package?\n";
    }

    # Get all .pref file names
    opendir my $fh, $self->{path_pref_en};
    my @pref_files = grep { /\.pref$/ } readdir($fh);

    bless $self, $class;
}


sub po_filename {
    my $self   = shift;
    my $suffix = shift;

    return $trans_file;
}

sub get_trans_text {
    my ($self, $msgctxt, $msgid) = @_;

    my $key = ($msgctxt // '') . ";$msgid";
    my ($self, $id, $comment) = @_;
    my $po = $self->{po};
    my $p = $po->{$id};
    if ( $p ) {
        $p->comment( $p->comment . "\n" . $comment );
    }
    else {
        $po->{$id} = Locale::PO->new(
            -comment => $comment,
            -msgid   => $id,
            -msgstr  => ''
        );
    }
}


    my $po = $self->{po}->{$key};
    if ($po) {
        my $msgstr = Locale::PO->dequote($po->msgstr);

        return $msgstr || $msgid;
        my $pref_name = '';
        for my $element ( @$pref ) {
            if ( ref( $element) eq 'HASH' ) {
                $pref_name = $element->{pref};
                last;
            }
        }
        for my $element ( @$pref ) {
            if ( ref( $element) eq 'HASH' ) {
                while ( my ($key, $value) = each(%$element) ) {
                    next unless $key eq 'choices' or $key eq 'multiple';
                    next unless ref($value) eq 'HASH';
                    for my $ckey ( keys %$value ) {
                        my $id = $self->{file} . "#$pref_name# " . $value->{$ckey};
                        $self->po_append( $id, $comment );
                    }
                }
            }
            elsif ( $element ) {
                $self->po_append( $self->{file} . "#$pref_name# $element", $comment );
            }
        }
    }
}

    return $msgid;
sub get_trans_text {
    my ($self, $id) = @_;

    my $po = $self->{po}->{$id};
    return unless $po;
    return Locale::PO->dequote($po->msgstr);
}

sub get_translated_tab_content {
    my ($self, $tab, $tab_content) = @_;

    if ( ref($tab_content) eq 'ARRAY' ) {
        return $self->get_translated_prefs($tab, $tab_content);

    for my $p ( @$prefs ) {
        my $pref_name = '';
        next unless $p;
        for my $element ( @$p ) {
            if ( ref( $element) eq 'HASH' ) {
                $pref_name = $element->{pref};
                last;
            }
        }
        for my $i ( 0..@$p-1 ) {
            my $element = $p->[$i];
            if ( ref( $element) eq 'HASH' ) {
                while ( my ($key, $value) = each(%$element) ) {
                    next unless $key eq 'choices' or $key eq 'multiple';
                    next unless ref($value) eq 'HASH';
                    for my $ckey ( keys %$value ) {
                        my $id = $self->{file} . "#$pref_name# " . $value->{$ckey};
                        my $text = $self->get_trans_text( $id );
                        $value->{$ckey} = $text if $text;
                    }
                }
            }
            elsif ( $element ) {
                my $id = $self->{file} . "#$pref_name# $element";
                my $text = $self->get_trans_text( $id );
                $p->[$i] = $text if $text;
            }
        }
    }
}

    my $translated_tab_content = {
        map {
            my $section = $_;
            my $sysprefs = $tab_content->{$section};
            my $context = "$tab > $section";

            $self->get_trans_text($tab, $section) => $self->get_translated_prefs($context, $sysprefs);
        } keys %$tab_content
    };

    return $translated_tab_content;
        my $pref = LoadFile( $self->{path_pref_en} . "/$file" );
        $self->{file} = $file;
        # Entries for tab titles
        $self->po_append( $self->{file}, $_ ) for keys %$pref;
        while ( my ($tab, $tab_content) = each %$pref ) {
            if ( ref($tab_content) eq 'ARRAY' ) {
                $self->add_prefs( $tab, $tab_content );
                next;
            }
            while ( my ($section, $sysprefs) = each %$tab_content ) {
                my $comment = "$tab > $section";
                $self->po_append( $self->{file} . " " . $section, $comment );
                $self->add_prefs( $comment, $sysprefs );
            }
        }
    }
}

sub get_translated_prefs {
    my ($self, $context, $sysprefs) = @_;

    my $translated_prefs = [
        map {
            my ($pref_elt) = grep { ref($_) eq 'HASH' && exists $_->{pref} } @$_;
            my $pref_name = $pref_elt ? $pref_elt->{pref} : '';

            my $translated_syspref = [
                map {
                    $self->get_translated_pref("$context > $pref_name", $_ );
                } @$_
            ];

            $translated_syspref;
        } @$sysprefs
    ];
}

    return $translated_prefs;
}

sub get_translated_pref {
    my ($self, $context, $syspref) = @_;

    unless (ref($syspref)) {
        return $self->get_trans_text($context, $syspref // '');
    }

    my $translated_pref = {
        map {
            my $key = $_;
            my $value = $syspref->{$key};

            my $translated_value = $value;
            if (($key eq 'choices' || $key eq 'multiple') && ref($value) eq 'HASH') {
                $translated_value = {
                    map {
                        $_ => $self->get_trans_text($context, $value->{$_})
                    } keys %$value
                }
            }

            $key => $translated_value
        } keys %$syspref
    };

    return $translated_pref;
    my $self = shift;
    print "Update '", $self->{lang},
          "' preferences .po file from 'en' .pref files\n" if $self->{verbose};
    $self->get_po_merged_with_en();
    $self->save_po();
}


sub install_prefs {
    my $self = shift;


        exit;
    }

    my @po_entries = @{ Locale::PO->load_file_asarray($self->po_filename("-pref.po"), 'utf8') };
    $self->{po} = { map {
        my $msgctxt = $_->msgctxt ? Locale::PO->dequote($_->msgctxt) : '';
        my $msgid = Locale::PO->dequote($_->msgid);

        "$msgctxt;$msgid" => $_;
    } @po_entries };

    for my $file ( @{$self->{pref_files}} ) {
        my $pref = LoadFile( $self->{path_pref_en} . "/$file" );

        my $translated_pref = {
            map {
                my $tab = $_;
                my $tab_content = $pref->{$tab};

                $self->get_trans_text(undef, $tab) => $self->get_translated_tab_content($tab, $tab_content);
            } keys %$pref
        };


                $self->update_tab_prefs( $pref, $tab_content );
                next;
            }
            while ( my ($section, $sysprefs) = each %$tab_content ) {
                $self->update_tab_prefs( $pref, $sysprefs );
            }
            my $ntab = {};
            for my $section ( keys %$tab_content ) {
                my $id = $self->{file} . " $section";
                my $text = $self->get_trans_text($id);
                my $nsection = $text ? $text : $section;
                if( exists $ntab->{$nsection} ) {
                    # When translations collide (see BZ 18634)
                    push @{$ntab->{$nsection}}, @{$tab_content->{$section}};
                } else {
                    $ntab->{$nsection} = $tab_content->{$section};
                }
            }
            $pref->{$tab} = $ntab;
        }
        my $file_trans = $self->{po_path_lang} . "/$file";
        print "Write $file\n" if $self->{verbose};
        DumpFile($file_trans, $translated_pref);
        print $fh Dump($pref);
    }
}


    }
}


sub update_tmpl {
    my ($self, $files) = @_;

    say "Update templates" if $self->{verbose};
    for my $trans ( @{$self->{interface}} ) {
        my @files   = @$files;
        my @nomarc = ();
        print
            "  Update templates '$trans->{name}'\n",
            "    From: $trans->{dir}/en/\n",
            "    To  : $self->{path_po}/$self->{lang}$trans->{suffix}\n"
                if $self->{verbose};

        my $trans_dir = join("/en/ -i ",split(" ",$trans->{dir}))."/en/"; # multiple source dirs
        # if processing MARC po file, only use corresponding files
        my $marc      = ( $trans->{name} =~ /MARC/ )?"-m \"$trans->{name}\"":"";            # for MARC translations
        # if not processing MARC po file, ignore all MARC files
        @nomarc       = ( 'marc21', 'unimarc', 'normarc' ) if ( $trans->{name} !~ /MARC/ );      # hardcoded MARC variants

        system
            "$self->{process} update " .
            "-i $trans_dir " .
            "-s $self->{path_po}/$self->{lang}$trans->{suffix} -r " .
            "$marc "     .
            ( @files   ? ' -f ' . join ' -f ', @files : '') .
            ( @nomarc  ? ' -n ' . join ' -n ', @nomarc : '');
    }
}


sub create_prefs {
    my $self = shift;

    if ( -e $self->po_filename("-pref.po") ) {
        say "Preferences .po file already exists. Delete it if you want to recreate it.";
        return;
    }
    $self->get_po_from_prefs();
    $self->save_po();
}

sub get_po_from_target {
    my $self   = shift;
    my $target = shift;

    my $po;
    my $po_head = new Locale::PO;
    $po_head->{msgid}  = "\"\"";
    $po_head->{msgstr} = "".
        "Project-Id-Version: Koha Project - Installation files\\n" .
        "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\n" .
        "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\\n" .
        "Language-Team: Koha Translation Team\\n" .
        "Language: ".$self->{lang}."\\n" .
        "MIME-Version: 1.0\\n" .
        "Content-Type: text/plain; charset=UTF-8\\n" .
        "Content-Transfer-Encoding: 8bit\\n";

    my @dirs = @{ $target->{dirs} };
    my $intradir = $self->{context}->config('intranetdir');
    for my $dir ( @dirs ) {                                                     # each dir
        opendir( my $dh, "$intradir/$dir" ) or die ("Can't open $intradir/$dir");
        my @filelist = grep { $_ =~ m/\.yml/ } readdir($dh);                    # Just yaml files
        close($dh);
        for my $file ( @filelist ) {                                            # each file
            my $yaml   = LoadFile( "$intradir/$dir/$file" );
            my @tables = @{ $yaml->{'tables'} };
            my $tablec;
            for my $table ( @tables ) {                                         # each table
                $tablec++;
                my $table_name = ( keys %$table )[0];
                my @translatable = @{ $table->{$table_name}->{translatable} };
                my @rows = @{ $table->{$table_name}->{rows} };
                my @multiline = @{ $table->{$table_name}->{'multiline'} };      # to check multiline values
                my $rowc;
                for my $row ( @rows ) {                                         # each row
                    $rowc++;
                    for my $field ( @translatable ) {                           # each field
                        if ( @multiline and grep { $_ eq $field } @multiline ) {    # multiline fields, only notices ATM
                            my $mulc;
                            foreach my $line ( @{$row->{$field}} ) {
                                $mulc++;
                                next if ( $line =~ /^(\s*<.*?>\s*$|^\s*\[.*?\]\s*|\s*)$/ );                     # discard pure html, TT, empty
                                $line =~ s/(<<.*?>>|\[\%.*?\%\]|<.*?>)/\%s/g;                                   # put placeholders
                                next if ( $line =~ /^(\s|%s|-|[[:punct:]]|\(|\))*$/ or length($line) < 2 );     # discard non strings
                                if ( not $po->{ $line } ) {
                                    my $msg = new Locale::PO(
                                                -msgid => $line, -msgstr => '',
                                                -reference => "$dir/$file:$table_name:$tablec:row:$rowc:mul:$mulc" );
                                    $po->{ $line } = $msg;
                                }
                            }
                        } else {
                            if ( defined $row->{$field} and length($row->{$field}) > 1                         # discard null values and small strings
                                 and not $po->{ $row->{$field} } ) {
                                my $msg = new Locale::PO(
                                            -msgid => $row->{$field}, -msgstr => '',
                                            -reference => "$dir/$file:$table_name:$tablec:row:$rowc" );
                                $po->{ $row->{$field} } = $msg;
                            }
                        }
                    }
                }
            }
            my $desccount;
            for my $description ( @{ $yaml->{'description'} } ) {
                $desccount++;
                if ( length($description) > 1 and not $po->{ $description } ) {
                    my $msg = new Locale::PO(
                                -msgid => $description, -msgstr => '',
                                -reference => "$dir/$file:description:$desccount" );
                    $po->{ $description } = $msg;
                }
            }
        }
    }
    $po->{''} = $po_head if ( $po );

    return $po;
}

sub create_installer {
    my $self = shift;
    return unless ( $self->{installer} );

    say "Create installer translation files\n" if $self->{verbose};

    my @targets = @{ $self->{installer} };             # each installer target (common,marc21,unimarc)

    for my $target ( @targets ) {
        if ( -e $self->po_filename( $target->{suffix} ) ) {
            say "$self->{lang}$target->{suffix} file already exists. Delete it if you want to recreate it.";
            return;
        }
    }

    for my $target ( @targets ) {
        my $po = get_po_from_target( $self, $target );
        # create output file only if there is something to write
        if ( $po ) {
            my $po_file = $self->po_filename( $target->{suffix} );
            Locale::PO->save_file_fromhash( $po_file, $po );
            say "Saved in file: ", $po_file if $self->{verbose};
        }
    }
}

sub update_installer {
    my $self = shift;
    return unless ( $self->{installer} );

    say "Update installer translation files\n" if $self->{verbose};

    my @targets = @{ $self->{installer} };             # each installer target (common,marc21,unimarc)

    for my $target ( @targets ) {
        return unless ( -e $self->po_filename( $target->{suffix} ) );
        my $po = get_po_from_target( $self, $target );
        # update file only if there is something to update
        if ( $po ) {
            my ( $fh, $po_temp ) = tempfile();
            binmode( $fh, ":encoding(UTF-8)" );
            Locale::PO->save_file_fromhash( $po_temp, $po );
            my $po_file = $self->po_filename( $target->{suffix} );
            eval {
                my $st = system($self->{msgmerge}." ".($self->{verbose}?'':'-q').
                         " -s $po_file $po_temp -o - | ".$self->{msgattrib}." --no-obsolete -o $po_file");
            };
            say "Updated file: ", $po_file if $self->{verbose};
        }
    }
}

sub translate_yaml {
    my $self   = shift;
    my $target = shift;

    }
}

sub create_tmpl {
    my ($self, $files) = @_;

    say "Create templates\n" if $self->{verbose};
    for my $trans ( @{$self->{interface}} ) {
        my @files   = @$files;
        my @nomarc = ();
        print
            "  Create templates .po files for '$trans->{name}'\n",
            "    From: $trans->{dir}/en/\n",
            "    To  : $self->{path_po}/$self->{lang}$trans->{suffix}\n"
                if $self->{verbose};

        my $trans_dir = join("/en/ -i ",split(" ",$trans->{dir}))."/en/"; # multiple source dirs
        # if processing MARC po file, only use corresponding files
        my $marc      = ( $trans->{name} =~ /MARC/ )?"-m \"$trans->{name}\"":"";            # for MARC translations
        # if not processing MARC po file, ignore all MARC files
        @nomarc       = ( 'marc21', 'unimarc', 'normarc' ) if ( $trans->{name} !~ /MARC/ ); # hardcoded MARC variants

        system
            "$self->{process} create " .
            "-i $trans_dir " .
            "-s $self->{path_po}/$self->{lang}$trans->{suffix} -r " .
            "$marc " .
            ( @files  ? ' -f ' . join ' -f ', @files   : '') .
            ( @nomarc ? ' -n ' . join ' -n ', @nomarc : '');
    }
}

sub locale_name {
    my $self = shift;


    return $locale;
}

sub create_messages {
    my $self = shift;

    my $pot = "$Bin/$self->{domain}.pot";
    my $po = "$self->{path_po}/$self->{lang}-messages.po";
    my $js_pot = "$self->{domain}-js.pot";
    my $js_po = "$self->{path_po}/$self->{lang}-messages-js.po";

    unless ( -f $pot && -f $js_pot ) {
        $self->extract_messages();
    }

    say "Create messages ($self->{lang})" if $self->{verbose};
    my $locale = $self->locale_name();
    system "$self->{msginit} -i $pot -o $po -l $locale --no-translator 2> /dev/null";
    warn "Problems creating $pot ".$? if ( $? == -1 );
    system "$self->{msginit} -i $js_pot -o $js_po -l $locale --no-translator 2> /dev/null";
    warn "Problems creating $js_pot ".$? if ( $? == -1 );

    # If msginit failed to correctly set Plural-Forms, set a default one
    system "$self->{sed} --in-place "
        . "--expression='s/Plural-Forms: nplurals=INTEGER; plural=EXPRESSION/Plural-Forms: nplurals=2; plural=(n != 1)/' "
        . "$po $js_po";
}

sub update_messages {
    my $self = shift;

    my $pot = "$Bin/$self->{domain}.pot";
    my $po = "$self->{path_po}/$self->{lang}-messages.po";
    my $js_pot = "$self->{domain}-js.pot";
    my $js_po = "$self->{path_po}/$self->{lang}-messages-js.po";

    unless ( -f $pot && -f $js_pot ) {
        $self->extract_messages();
    }

    if ( -f $po && -f $js_pot ) {
        say "Update messages ($self->{lang})" if $self->{verbose};
        system "$self->{msgmerge} --backup=off --quiet -U $po $pot";
        system "$self->{msgmerge} --backup=off --quiet -U $js_po $js_pot";
    } else {
        $self->create_messages();
    }
}

sub extract_messages_from_templates {
    my ($self, $tempdir, $type, @files) = @_;

    my $htdocs = $type eq 'intranet' ? 'intrahtdocs' : 'opachtdocs';
    my $dir = $self->{context}->config($htdocs);
    my @keywords = qw(t tx tn txn tnx tp tpx tnp tnpx);
    my $parser = Template::Parser->new();

    foreach my $file (@files) {
        say "Extract messages from $file" if $self->{verbose};
        my $template = read_file(File::Spec->catfile($dir, $file));

        # No need to process a file that doesn't use the i18n.inc file.
        next unless $template =~ /i18n\.inc/;

        my $data = $parser->parse($template);
        unless ($data) {
            warn "Error at $file : " . $parser->error();
            next;
        }

        my $destfile = $type eq 'intranet' ?
            File::Spec->catfile($tempdir, 'koha-tmpl', 'intranet-tmpl', $file) :
            File::Spec->catfile($tempdir, 'koha-tmpl', 'opac-tmpl', $file);

        make_path(dirname($destfile));
        open my $fh, '>', $destfile;

        my @blocks = ($data->{BLOCK}, values %{ $data->{DEFBLOCKS} });
        foreach my $block (@blocks) {
            my $document = PPI::Document->new(\$block);

            # [% t('foo') %] is compiled to
            # $output .= $stash->get(['t', ['foo']]);
            # We try to find all nodes corresponding to keyword (here 't')
            my $nodes = $document->find(sub {
                my ($topnode, $element) = @_;

                # Filter out non-valid keywords
                return 0 unless ($element->isa('PPI::Token::Quote::Single'));
                return 0 unless (grep {$element->content eq qq{'$_'}} @keywords);

                # keyword (e.g. 't') should be the first element of the arrayref
                # passed to $stash->get()
                return 0 if $element->sprevious_sibling;

                return 0 unless $element->snext_sibling
                    && $element->snext_sibling->snext_sibling
                    && $element->snext_sibling->snext_sibling->isa('PPI::Structure::Constructor');

                # Check that it's indeed a call to $stash->get()
                my $statement = $element->statement->parent->statement->parent->statement;
                return 0 unless grep { $_->isa('PPI::Token::Symbol') && $_->content eq '$stash' } $statement->children;
                return 0 unless grep { $_->isa('PPI::Token::Operator') && $_->content eq '->' } $statement->children;
                return 0 unless grep { $_->isa('PPI::Token::Word') && $_->content eq 'get' } $statement->children;

                return 1;
            });

            next unless $nodes;

            # Write the Perl equivalent of calls to t* functions family, so
            # xgettext can extract the strings correctly
            foreach my $node (@$nodes) {
                my @args = map {
                    $_->significant && !$_->isa('PPI::Token::Operator') ? $_->content : ()
                } $node->snext_sibling->snext_sibling->find_first('PPI::Statement')->children;

                my $keyword = $node->content;
                $keyword =~ s/^'t(.*)'$/__$1/;

                # Only keep required args to have a clean output
                my @required_args = shift @args;
                push @required_args, shift @args if $keyword =~ /n/;
                push @required_args, shift @args if $keyword =~ /p/;

                say $fh "$keyword(" . join(', ', @required_args) . ");";
            }

        }

        close $fh;
    }

    return $tempdir;
}

sub extract_messages {
    my $self = shift;

    say "Extract messages into POT file" if $self->{verbose};

    my $intranetdir = $self->{context}->config('intranetdir');
    my $opacdir = $self->{context}->config('opacdir');

    # Find common ancestor directory
    my @intranetdirs = File::Spec->splitdir($intranetdir);
    my @opacdirs = File::Spec->splitdir($opacdir);
    my @basedirs;
    while (@intranetdirs and @opacdirs) {
        my ($dir1, $dir2) = (shift @intranetdirs, shift @opacdirs);
        last if $dir1 ne $dir2;
        push @basedirs, $dir1;
    }
    my $basedir = File::Spec->catdir(@basedirs);

    my @files_to_scan;
    my @directories_to_scan = ('.');
    my @blacklist = map { File::Spec->catdir(@intranetdirs, $_) } qw(blib koha-tmpl skel tmp t);
    while (@directories_to_scan) {
        my $dir = shift @directories_to_scan;
        opendir DIR, File::Spec->catdir($basedir, $dir) or die "Unable to open $dir: $!";
        foreach my $entry (readdir DIR) {
            next if $entry =~ /^\./;
            my $relentry = File::Spec->catfile($dir, $entry);
            my $abspath = File::Spec->catfile($basedir, $relentry);
            if (-d $abspath and not grep { $_ eq $relentry } @blacklist) {
                push @directories_to_scan, $relentry;
            } elsif (-f $abspath and $relentry =~ /\.(pl|pm)$/) {
                push @files_to_scan, $relentry;
            }
        }
    }

    my $intrahtdocs = $self->{context}->config('intrahtdocs');
    my $opachtdocs = $self->{context}->config('opachtdocs');

    my @intranet_tt_files;
    find(sub {
        if ($File::Find::dir =~ m|/en/| && $_ =~ m/\.(tt|inc)$/) {
            my $filename = $File::Find::name;
            $filename =~ s|^$intrahtdocs/||;
            push @intranet_tt_files, $filename;
        }
    }, $intrahtdocs);

    my @opac_tt_files;
    find(sub {
        if ($File::Find::dir =~ m|/en/| && $_ =~ m/\.(tt|inc)$/) {
            my $filename = $File::Find::name;
            $filename =~ s|^$opachtdocs/||;
            push @opac_tt_files, $filename;
        }
    }, $opachtdocs);

    my $tempdir = tempdir('Koha-translate-XXXX', TMPDIR => 1, CLEANUP => 1);
    $self->extract_messages_from_templates($tempdir, 'intranet', @intranet_tt_files);
    $self->extract_messages_from_templates($tempdir, 'opac', @opac_tt_files);

    @intranet_tt_files = map { File::Spec->catfile('koha-tmpl', 'intranet-tmpl', $_) } @intranet_tt_files;
    @opac_tt_files = map { File::Spec->catfile('koha-tmpl', 'opac-tmpl', $_) } @opac_tt_files;
    my @tt_files = grep { -e File::Spec->catfile($tempdir, $_) } @intranet_tt_files, @opac_tt_files;

    push @files_to_scan, @tt_files;

    my $xgettext_common_args = "--force-po --from-code=UTF-8 "
        . "--package-name=Koha --package-version='' "
        . "-k -k__ -k__x -k__n:1,2 -k__nx:1,2 -k__xn:1,2 -k__p:1c,2 "
        . "-k__px:1c,2 -k__np:1c,2,3 -k__npx:1c,2,3 -kN__ -kN__n:1,2 "
        . "-kN__p:1c,2 -kN__np:1c,2,3 ";
    my $xgettext_cmd = "$self->{xgettext} -L Perl $xgettext_common_args "
        . "-o $Bin/$self->{domain}.pot -D $tempdir -D $basedir";
    $xgettext_cmd .= " $_" foreach (@files_to_scan);

    if (system($xgettext_cmd) != 0) {
        die "system call failed: $xgettext_cmd";
    }

    my @js_dirs = (
        "$intrahtdocs/prog/js",
        "$opachtdocs/bootstrap/js",
    );

    my @js_files;
    find(sub {
        if ($_ =~ m/\.js$/) {
            my $filename = $File::Find::name;
            $filename =~ s|^$intranetdir/||;
            push @js_files, $filename;
        }
    }, @js_dirs);

    $xgettext_cmd = "$self->{xgettext} -L JavaScript $xgettext_common_args "
        . "-o $Bin/$self->{domain}-js.pot -D $intranetdir";
    $xgettext_cmd .= " $_" foreach (@js_files);

    if (system($xgettext_cmd) != 0) {
        die "system call failed: $xgettext_cmd";
    }

    my $replace_charset_cmd = "$self->{sed} --in-place " .
        "--expression='s/charset=CHARSET/charset=UTF-8/' " .
        "$Bin/$self->{domain}.pot $Bin/$self->{domain}-js.pot";
    if (system($replace_charset_cmd) != 0) {
        die "system call failed: $replace_charset_cmd";
    }
}

sub install_messages {
    my ($self) = @_;


    my $js_pofile = "$self->{path_po}/$self->{lang}-messages-js.po";

    unless ( -f $pofile && -f $js_pofile ) {
        die "PO files for language '$self->{lang}' do not exist";
    }

    say "Install messages ($locale)" if $self->{verbose};
    make_path($modir);
    system "$self->{msgfmt} -o $mofile $pofile";

    }
}

sub remove_pot {
    my $self = shift;

    unlink "$Bin/$self->{domain}.pot";
    unlink "$Bin/$self->{domain}-js.pot";
}

sub compress {
    my ($self, $files) = @_;
    my @langs = $self->{lang} ? ($self->{lang}) : $self->get_all_langs();

    my ($self, $files) = @_;
    return unless $self->{lang};
    $self->uncompress();

    if ($self->{pref_only}) {
        $self->install_prefs();
    } else {
        $self->install_tmpl($files);
        $self->install_prefs();
        $self->install_messages();
        $self->install_installer();
    }
}



    @files = map { $_ =~ s/-pref.(po|po.gz)$//r } @files;
}


sub update {
    my ($self, $files) = @_;
    my @langs = $self->{lang} ? ($self->{lang}) : $self->get_all_langs();
    for my $lang ( @langs ) {
        $self->set_lang( $lang );
        $self->uncompress();
        $self->update_tmpl($files) unless $self->{pref_only};
        $self->update_prefs();
        $self->update_messages();
        $self->update_installer();
    }
    $self->remove_pot();
}


sub create {
    my ($self, $files) = @_;
    return unless $self->{lang};
    $self->create_tmpl($files) unless $self->{pref_only};
    $self->create_prefs();
    $self->create_messages();
    $self->remove_pot();
    $self->create_installer();
}



1;



Lines 1-5 Link Here

(-)a/misc/translator/po/dz-pref.po (-1 / +9 lines)
1	msgid ""	1	msgid ""
2	msgstr "Project-Id-Version: PACKAGE VERSION\\nPO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\nLast-Translator: FULL NAME <EMAIL@ADDRESS>\\nLanguage-Team: Koha Translate List <koha-translate@lists.koha-community.org>\\nMIME-Version: 1.0\\nContent-Type: text/plain; charset=UTF-8\\nContent-Transfer-Encoding: 8bit\\nPlural-Forms: nplurals=2; plural=(n > 1);\\n"	2	msgstr ""
		3	"Project-Id-Version: PACKAGE VERSION\n"
		4	"PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
		5	"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
		6	"Language-Team: Koha Translate List <koha-translate@lists.koha-community.org>\n"
		7	"MIME-Version: 1.0\n"
		8	"Content-Type: text/plain; charset=UTF-8\n"
		9	"Content-Transfer-Encoding: 8bit\n"
		10	"Plural-Forms: nplurals=2; plural=(n > 1);\n"
3		11
4	# Accounting	12	# Accounting
5	msgid "accounting.pref"	13	msgid "accounting.pref"

Lines 1-5 Link Here

(-)a/misc/translator/po/gd-pref.po (-1 / +9 lines)
1	msgid ""	1	msgid ""
2	msgstr "Project-Id-Version: PACKAGE VERSION\\nPO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\nLast-Translator: FULL NAME <EMAIL@ADDRESS>\\nLanguage-Team: Koha Translate List <koha-translate@lists.koha-community.org>\\nMIME-Version: 1.0\\nContent-Type: text/plain; charset=UTF-8\\nContent-Transfer-Encoding: 8bit\\nPlural-Forms: nplurals=2; plural=(n > 1);\\n"	2	msgstr ""
		3	"Project-Id-Version: PACKAGE VERSION\n"
		4	"PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
		5	"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
		6	"Language-Team: Koha Translate List <koha-translate@lists.koha-community.org>\n"
		7	"MIME-Version: 1.0\n"
		8	"Content-Type: text/plain; charset=UTF-8\n"
		9	"Content-Transfer-Encoding: 8bit\n"
		10	"Plural-Forms: nplurals=2; plural=(n > 1);\n"
3		11
4	# Accounting	12	# Accounting
5	msgid "accounting.pref"	13	msgid "accounting.pref"

Lines 1-5 Link Here

(-)a/misc/translator/po/lv-pref.po (-1 / +9 lines)
1	msgid ""	1	msgid ""
2	msgstr "Project-Id-Version: PACKAGE VERSION\\nPO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\nLast-Translator: FULL NAME <EMAIL@ADDRESS>\\nLanguage-Team: Koha Translate List <koha-translate@lists.koha-community.org>\\nMIME-Version: 1.0\\nContent-Type: text/plain; charset=UTF-8\\nContent-Transfer-Encoding: 8bit\\nPlural-Forms: nplurals=2; plural=(n > 1);\\n"	2	msgstr ""
		3	"Project-Id-Version: PACKAGE VERSION\n"
		4	"PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
		5	"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
		6	"Language-Team: Koha Translate List <koha-translate@lists.koha-community.org>\n"
		7	"MIME-Version: 1.0\n"
		8	"Content-Type: text/plain; charset=UTF-8\n"
		9	"Content-Transfer-Encoding: 8bit\n"
		10	"Plural-Forms: nplurals=2; plural=(n > 1);\n"
3		11
4	# Accounting	12	# Accounting
5	msgid "accounting.pref"	13	msgid "accounting.pref"

Lines 1-5 Link Here

(-)a/misc/translator/po/te-pref.po (-1 / +9 lines)
1	msgid ""	1	msgid ""
2	msgstr "Project-Id-Version: PACKAGE VERSION\\nPO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\nLast-Translator: FULL NAME <EMAIL@ADDRESS>\\nLanguage-Team: Koha Translate List <koha-translate@lists.koha-community.org>\\nMIME-Version: 1.0\\nContent-Type: text/plain; charset=UTF-8\\nContent-Transfer-Encoding: 8bit\\nPlural-Forms: nplurals=2; plural=(n > 1);\\n"	2	msgstr ""
		3	"Project-Id-Version: PACKAGE VERSION\n"
		4	"PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
		5	"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
		6	"Language-Team: Koha Translate List <koha-translate@lists.koha-community.org>\n"
		7	"MIME-Version: 1.0\n"
		8	"Content-Type: text/plain; charset=UTF-8\n"
		9	"Content-Transfer-Encoding: 8bit\n"
		10	"Plural-Forms: nplurals=2; plural=(n > 1);\n"
3		11
4	# Accounting	12	# Accounting
5	msgid "accounting.pref"	13	msgid "accounting.pref"




    my($exitcode) = @_;
    my $h = $exitcode? *STDERR: *STDOUT;
    print $h <<EOF;
Usage: $0 install [OPTION]
  or:  $0 update [OPTION]
  or:  $0 install [OPTION]
  or:  $0 --help
Install translated templates.

  -i, --input=SOURCE          Get or update strings from SOURCE directory(s).
                              On create or update can have multiple values.

      --help                  Display this help and exit
  -q, --quiet                 no output to screen (except for errors)

The -o option is ignored for the "create" and "update" actions.
Try `perldoc $0` for perhaps more information.
EOF
    exit($exitcode);

VerboseWarnings::set_application_name($0);
VerboseWarnings::set_pedantic_mode($pedantic_p);

# keep the buggy Locale::PO quiet if it says stupid things
$SIG{__WARN__} = sub {
    my($s) = @_;
    print STDERR $s unless $s =~ /^Strange line in [^:]+: #~/s
    };

my $action = shift or usage_error('You must specify an ACTION.');
usage_error('You must at least specify input and string list filenames.')
    if !@in_dirs || !defined $str_file;

    $charset_out = TmplTokenizer::charset_canon('UTF-8');
    warn "Warning: Charset Out defaulting to $charset_out\n" unless ( $quiet );
}
my $xgettext = './xgettext.pl'; # actual text extractor script
my $st;

if ($action eq 'install') {
    # updates the list. As the list is empty, every entry will be added
    if (!-s $str_file) {
    warn "Removing empty file $str_file\n" unless ( $quiet );
    unlink $str_file || die "$str_file: $!\n";
    }
    die "$str_file: Output file already exists\n" if -f $str_file;
    my($tmph1, $tmpfile1) = tmpnam();
    my($tmph2, $tmpfile2) = tmpnam();
    close $tmph2; # We just want a name
    # Generate the temporary file that acts as <MODULE>/POTFILES.in
    for my $input (@in_files) {
    print $tmph1 "$input\n";
    }
    close $tmph1;
    warn "I $charset_in O $charset_out" unless ( $quiet );
    # Generate the specified po file ($str_file)
    $st = system ($xgettext, '-s', '-f', $tmpfile1, '-o', $tmpfile2,
            (defined $charset_in? ('-I', $charset_in): ()),
            (defined $charset_out? ('-O', $charset_out): ())
    );
    # Run msgmerge so that the pot file looks like a real pot file
    # We need to help msgmerge a bit by pre-creating a dummy po file that has
    # the headers and the "" msgid & msgstr. It will fill in the rest.
    if ($st == 0) {
    # Merge the temporary "pot file" with the specified po file ($str_file)
    # FIXME: msgmerge(1) is a Unix dependency
    # FIXME: need to check the return value
    unless (-f $str_file) {
        open(my $infh, '<', $tmpfile2);
        open(my $outfh, '>', $str_file);
        while (<$infh>) {
        print $outfh $_;
        last if /^\n/s;
        }
        close $infh;
        close $outfh;
    }
    $st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile2 -o - | msgattrib --no-obsolete -o $str_file");
    } else {
    error_normal("Text extraction failed: $xgettext: $!\n", undef);
    error_additional("Will not run msgmerge\n", undef);
    }
    unlink $tmpfile1 || warn_normal("$tmpfile1: unlink failed: $!\n", undef);
    unlink $tmpfile2 || warn_normal("$tmpfile2: unlink failed: $!\n", undef);

} elsif ($action eq 'update') {
    my($tmph1, $tmpfile1) = tmpnam();
    my($tmph2, $tmpfile2) = tmpnam();
    close $tmph2; # We just want a name
    # Generate the temporary file that acts as <MODULE>/POTFILES.in
    for my $input (@in_files) {
    print $tmph1 "$input\n";
    }
    close $tmph1;
    # Generate the temporary file that acts as <MODULE>/<LANG>.pot
    $st = system($xgettext, '-s', '-f', $tmpfile1, '-o', $tmpfile2,
        '--po-mode',
        (defined $charset_in? ('-I', $charset_in): ()),
        (defined $charset_out? ('-O', $charset_out): ()));
    if ($st == 0) {
        # Merge the temporary "pot file" with the specified po file ($str_file)
        # FIXME: msgmerge(1) is a Unix dependency
        # FIXME: need to check the return value
        if ( @filenames ) {
            my ($tmph3, $tmpfile3) = tmpnam();
            $st = system("msgcat $str_file $tmpfile2 > $tmpfile3");
            $st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile3 -o - | msgattrib --no-obsolete -o $str_file")
                unless $st;
        } else {
            $st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile2 -o - | msgattrib --no-obsolete -o $str_file");
        }
    } else {
        error_normal("Text extraction failed: $xgettext: $!\n", undef);
        error_additional("Will not run msgmerge\n", undef);
    }
    unlink $tmpfile1 || warn_normal("$tmpfile1: unlink failed: $!\n", undef);
    unlink $tmpfile2 || warn_normal("$tmpfile2: unlink failed: $!\n", undef);

} elsif ($action eq 'install') {
    if(!defined($out_dir)) {
    usage_error("You must specify an output directory when using the install method.");
    }

Using the PO format also means translators can add their
own comments in the translation files, if necessary.

=item -

Create, update, and install actions are all based on the
same scanner module. This ensures that update and install
have the same idea of what is a translatable string;
attribute names in tags, for example, will not be
accidentally translated.

=back

=head1 NOTES

Anchors are represented by an <AI<n>> notation.
The meaning of this non-standard notation might not be obvious.

The create action calls xgettext.pl to do the actual work;
the update action calls xgettext.pl, msgmerge(1) and msgattrib(1)
to do the actual work.

=head1 BUGS

xgettext.pl must be present in the current directory; both
msgmerge(1) and msgattrib(1) must also be present in the search path.
The script currently does not check carefully whether these
dependent commands are present.

Locale::PO(3) has a lot of bugs. It can neither parse nor
generate GNU PO files properly; a couple of workarounds have
been written in TmplTokenizer and more is likely to be needed
(e.g., to get rid of the "Strange line" warning for #~).

This script may not work in Windows.

There are probably some other bugs too, since this has not been


=head1 SEE ALSO

xgettext.pl,
TmplTokenizer.pm,
msgmerge(1),
Locale::PO(3),
translator_doc.txt

http://www.saas.nsw.edu.au/koha_wiki/index.php?page=DifficultTerms

=cut





my ($cmd, $lang) = @ARGV;
$cmd = lc $cmd;
if ( $cmd =~ /^(install|compress|uncompress)$/ ) {
    my $installer = LangInstaller->new( $lang, $pref, $verbose );
    if ( $lang and not grep( {$_ eq $lang} @{ $installer->{langs} } ) ) {
        print "Unsupported language: $lang\n";
        exit;
    }
    if ( $all ) {
        usage() if $cmd eq 'create';
        for my $lang ( @{$installer->{langs}} ) {
            $installer->set_lang( $lang );
            $installer->$cmd(\@files);


=head1 SYNOPSYS

  translate create fr-FR
  translate update fr-FR
  translate install fr-FR
  translate install fr-FR -f search -f memberentry
  translate -p install fr-FR
  translate install
  translate compress [fr-FR]
  translate uncompress [fr-FR]



In Koha, three categories of information are translated based on standard GNU
.po files: opac templates pages, intranet templates and system preferences. The
script is a wrapper. It allows to quickly install .po files for a
given language or for all available languages.

=head1 USAGE


=over

=item translate create F<lang>

Create 3 .po files in F</misc/translator/po> subdirectory: (1) from opac pages
templates, (2) intranet templates, and (3) from preferences. English 'en'
version of templates and preferences are used as references.

=over

=item F<lang>-opac-{theme}.po

Contains extracted text from english (en) OPAC templates found in
<KOHA_ROOT>/koha-tmpl/opac-tmpl/{theme}/en/ directory.

=item F<lang>-intranet.po

Contains extracted text from english (en) intranet templates found in
<KOHA_ROOT>/koha-tmpl/intranet-tmpl/prog/en/ directory.

=item F<lang>-pref.po

Contains extracted text from english (en) preferences. They are found in files
located in <KOHA_ROOT>/koha-tmpl/intranet-tmpl/prog/en/admin/preferences
directory.

=back

=item translate [-p] update F<lang>

Update .po files in F<po> directory, named F<lang>-*.po. Without F<lang>, all
available languages are updated. With -p option, only preferences .po file is
updated.

=item translate [-p|-f] install F<lang>

Use .po files to translate the english version of templates and preferences files




#!/usr/bin/perl

=head1 NAME

xgettext-installer - extract translatable strings from installer YAML files

=head1 SYNOPSIS

xgettext-installer [OPTION] [INPUTFILE]...

=head1 OPTIONS

=over

=item B<-f, --files-from=FILE>

get list of input files from FILE

=item B<-o, --output=FILE>

write output to the specified file

=item B<-h, --help>

display this help and exit

=back

=cut

use Modern::Perl;

use Getopt::Long;
use Locale::PO;
use Pod::Usage;
use YAML::Syck qw(LoadFile);

$YAML::Syck::ImplicitTyping = 1;

my $output = 'messages.pot';
my $files_from;
my $help;

GetOptions(
    'output=s' => \$output,
    'files-from=s' => \$files_from,
    'help' => \$help,
) or pod2usage(-verbose => 1, -exitval => 2);

if ($help) {
    pod2usage(-verbose => 1, -exitval => 0);
}

my @files = @ARGV;
if ($files_from) {
    open(my $fh, '<', $files_from) or die "Cannot open $files_from: $!";
    push @files, <$fh>;
    chomp @files;
    close $fh;
}

my $pot = {
    '' => Locale::PO->new(
        -msgid  => '',
        -msgstr =>
            "Project-Id-Version: Koha\n"
          . "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
          . "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\n"
          . "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\n"
          . "MIME-Version: 1.0\n"
          . "Content-Type: text/plain; charset=UTF-8\n"
          . "Content-Transfer-Encoding: 8bit\n"
    ),
};

for my $file (@files) {
    my $yaml = LoadFile($file);
    my @tables = @{ $yaml->{'tables'} };

    my $tablec = 0;
    for my $table (@tables) {
        $tablec++;

        my $table_name = ( keys %$table )[0];
        my @translatable = @{ $table->{$table_name}->{translatable} };
        my @rows = @{ $table->{$table_name}->{rows} };
        my @multiline = @{ $table->{$table_name}->{'multiline'} };

        my $rowc = 0;
        for my $row (@rows) {
            $rowc++;

            for my $field (@translatable) {
                if ( @multiline and grep { $_ eq $field } @multiline ) {
                    # multiline fields, only notices ATM
                    my $mulc;
                    foreach my $line ( @{ $row->{$field} } ) {
                        $mulc++;

                        # discard pure html, TT, empty
                        next if ( $line =~ /^(\s*<.*?>\s*$|^\s*\[.*?\]\s*|\s*)$/ );

                        # put placeholders
                        $line =~ s/(<<.*?>>|\[\%.*?\%\]|<.*?>)/\%s/g;

                        # discard non strings
                        next if ( $line =~ /^(\s|%s|-|[[:punct:]]|\(|\))*$/ or length($line) < 2 );
                        if ( not $pot->{$line} ) {
                            my $msg = new Locale::PO(
                                -msgid  => $line,
                                -msgstr => '',
                                -reference => "$file:$table_name:$tablec:row:$rowc:mul:$mulc"
                            );
                            $pot->{$line} = $msg;
                        }
                    }
                } elsif (defined $row->{$field} && length($row->{$field}) > 1 && !$pot->{ $row->{$field} }) {
                    my $msg = new Locale::PO(
                        -msgid     => $row->{$field},
                        -msgstr    => '',
                        -reference => "$file:$table_name:$tablec:row:$rowc"
                    );
                    $pot->{ $row->{$field} } = $msg;
                }
            }
        }
    }

    my $desccount = 0;
    for my $description ( @{ $yaml->{'description'} } ) {
        $desccount++;
        if ( length($description) > 1 and not $pot->{$description} ) {
            my $msg = new Locale::PO(
                -msgid     => $description,
                -msgstr    => '',
                -reference => "$file:description:$desccount"
            );
            $pot->{$description} = $msg;
        }
    }
}

Locale::PO->save_file_fromhash($output, $pot);




#!/usr/bin/perl

=head1 NAME

xgettext-pref - extract translatable strings from system preferences YAML files

=head1 SYNOPSIS

xgettext-pref [OPTION] [INPUTFILE]...

=head1 OPTIONS

=over

=item B<-f, --files-from=FILE>

get list of input files from FILE

=item B<-o, --output=FILE>

write output to the specified file

=item B<-h, --help>

display this help and exit

=back

=cut

use Modern::Perl;

use Getopt::Long;
use Locale::PO;
use Pod::Usage;
use YAML::Syck qw(LoadFile);

$YAML::Syck::ImplicitTyping = 1;

my $output = 'messages.pot';
my $files_from;
my $help;

GetOptions(
    'output=s' => \$output,
    'files-from=s' => \$files_from,
    'help' => \$help,
) or pod2usage(-verbose => 1, -exitval => 2);

if ($help) {
    pod2usage(-verbose => 1, -exitval => 0);
}

my @files = @ARGV;
if ($files_from) {
    open(my $fh, '<', $files_from) or die "Cannot open $files_from: $!";
    push @files, <$fh>;
    chomp @files;
    close $fh;
}

my $pot = {
    '' => Locale::PO->new(
        -msgid  => '',
        -msgstr => "Project-Id-Version: Koha\n"
          . "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
          . "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\n"
          . "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\n"
          . "MIME-Version: 1.0\n"
          . "Content-Type: text/plain; charset=UTF-8\n"
          . "Content-Transfer-Encoding: 8bit\n"
    ),
};

for my $file (@files) {
    my $pref = LoadFile($file);
    while ( my ($tab, $tab_content) = each %$pref ) {
        add_po($file, undef, $tab);

        if ( ref($tab_content) eq 'ARRAY' ) {
            add_prefs( $file, $tab, $tab_content );
        } else {
            while ( my ($section, $sysprefs) = each %$tab_content ) {
                my $context = "$tab > $section";
                add_po($file, $tab, $section);
                add_prefs( $file, $context, $sysprefs );
            }
        }
    }
}

Locale::PO->save_file_fromhash($output, $pot);

sub add_prefs {
    my ($file, $context, $prefs) = @_;

    for my $pref (@$prefs) {
        my $pref_name = '';
        for my $element (@$pref) {
            if ( ref($element) eq 'HASH' ) {
                $pref_name = $element->{pref};
                last;
            }
        }
        for my $element (@$pref) {
            if ( ref($element) eq 'HASH' ) {
                while ( my ( $key, $value ) = each(%$element) ) {
                    next unless $key eq 'choices' or $key eq 'multiple';
                    next unless ref($value) eq 'HASH';
                    for my $ckey ( keys %$value ) {
                        add_po( $file, "$context > $pref_name", $value->{$ckey} );
                    }
                }
            }
            elsif ($element) {
                add_po( $file, "$context > $pref_name", $element );
            }
        }
    }
}

sub add_po {
    my ( $reference, $msgctxt, $msgid ) = @_;

    return unless $msgid;

    my $key = ($msgctxt // '') . ";$msgid";
    $pot->{$key} = Locale::PO->new(
        -reference => $reference,
        -msgctxt   => $msgctxt,
        -msgid     => $msgid,
        -msgstr    => '',
    );
}




#!/usr/bin/perl

use Modern::Perl;

my $xgettext = Locale::XGettext::TT2::Koha->newFromArgv(\@ARGV);
$xgettext->setOption('plug_in', '');
$xgettext->run;
$xgettext->output;

package Locale::XGettext::TT2::Koha;

use parent 'Locale::XGettext::TT2';

sub defaultKeywords {
    return [
        't:1',
        'tx:1',
        'tn:1,2',
        'tnx:1,2',
        'txn:1,2',
        'tp:1c,2',
        'tpx:1c,2',
        'tnp:1c,2,3',
        'tnpx:1c,2,3',
    ];
}

sub defaultFlags {
    return [
        'tx:1:perl-brace-format',
        'tnx:1:perl-brace-format',
        'tnx:2:perl-brace-format',
        'txn:1:perl-brace-format',
        'txn:2:perl-brace-format',
        'tpx:2:perl-brace-format',
        'tnpx:2:perl-brace-format',
        'tnpx:3:perl-brace-format',
    ],
}

1;

Lines 173-179 EOF Link Here

(-)a/misc/translator/xgettext.pl (-1 / +1 lines)
173	print $OUTPUT <<EOF;	173	print $OUTPUT <<EOF;
174	msgid ""	174	msgid ""
175	msgstr ""	175	msgstr ""
176	"Project-Id-Version: PACKAGE VERSION\\n"	176	"Project-Id-Version: Koha\\n"
177	"POT-Creation-Date: $time_pot\\n"	177	"POT-Creation-Date: $time_pot\\n"
178	"PO-Revision-Date: $time_po\\n"	178	"PO-Revision-Date: $time_po\\n"
179	"Last-Translator: FULL NAME <EMAIL\@ADDRESS>\\n"	179	"Last-Translator: FULL NAME <EMAIL\@ADDRESS>\\n"

Lines 10-20 Link Here

(-)a/package.json (+3 lines)
10	"bootstrap": "^4.5.2",	10	"bootstrap": "^4.5.2",
11	"gulp": "^4.0.2",	11	"gulp": "^4.0.2",
12	"gulp-autoprefixer": "^4.0.0",	12	"gulp-autoprefixer": "^4.0.0",
		13	"gulp-concat-po": "^1.0.0",
13	"gulp-cssnano": "^2.1.2",	14	"gulp-cssnano": "^2.1.2",
		15	"gulp-exec": "^4.0.0",
14	"gulp-rename": "^2.0.0",	16	"gulp-rename": "^2.0.0",
15	"gulp-rtlcss": "^1.4.1",	17	"gulp-rtlcss": "^1.4.1",
16	"gulp-sass": "^3.1.0",	18	"gulp-sass": "^3.1.0",
17	"gulp-sourcemaps": "^2.6.1",	19	"gulp-sourcemaps": "^2.6.1",
		20	"merge-stream": "^2.0.0",
18	"minimist": "^1.2.5"	21	"minimist": "^1.2.5"
19	},	22	},
20	"scripts": {	23	"scripts": {




use Modern::Perl;

use FindBin '$Bin';
use lib "$Bin/../misc/translator";

use Test::More tests => 39;
use File::Temp qw(tempdir);
use File::Slurp;
use Locale::PO;

use t::lib::Mocks;

use_ok('LangInstaller');

my $installer = LangInstaller->new();

my $tempdir = tempdir(CLEANUP => 0);
t::lib::Mocks::mock_config('intrahtdocs', "$Bin/LangInstaller/templates");
my @files = ('simple.tt');
$installer->extract_messages_from_templates($tempdir, 'intranet', @files);

my $tempfile = "$tempdir/koha-tmpl/intranet-tmpl/simple.tt";
ok(-e $tempfile, 'it has created a temporary file simple.tt');
SKIP: {
    skip "simple.tt does not exist", 37 unless -e $tempfile;

    my $output = read_file($tempfile);
    my $expected_output = <<'EOF';
__('hello');
__x('hello {name}');
__n('item', 'items');
__nx('{count} item', '{count} items');
__p('context', 'hello');
__px('context', 'hello {name}');
__np('context', 'item', 'items');
__npx('context', '{count} item', '{count} items');
__npx('context', '{count} item', '{count} items');
__x('status is {status}');
__('active');
__('inactive');
__('Inside block');
EOF

    is($output, $expected_output, "Output of extract_messages_from_templates is as expected");

    my $xgettext_cmd = "xgettext -L Perl --from-code=UTF-8 "
        . "--package-name=Koha --package-version='' "
        . "-k -k__ -k__x -k__n:1,2 -k__nx:1,2 -k__xn:1,2 -k__p:1c,2 "
        . "-k__px:1c,2 -k__np:1c,2,3 -k__npx:1c,2,3 "
        . "-o $tempdir/Koha.pot -D $tempdir koha-tmpl/intranet-tmpl/simple.tt";

    system($xgettext_cmd);
    my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");

    my @expected = (
        {
            msgid => '"hello"',
        },
        {
            msgid => '"hello {name}"',
        },
        {
            msgid => '"item"',
            msgid_plural => '"items"',
        },
        {
            msgid => '"{count} item"',
            msgid_plural => '"{count} items"',
        },
        {
            msgid => '"hello"',
            msgctxt => '"context"',
        },
        {
            msgid => '"hello {name}"',
            msgctxt => '"context"',
        },
        {
            msgid => '"item"',
            msgid_plural => '"items"',
            msgctxt => '"context"',
        },
        {
            msgid => '"{count} item"',
            msgid_plural => '"{count} items"',
            msgctxt => '"context"',
        },
        {
            msgid => '"status is {status}"',
        },
        {
            msgid => '"active"',
        },
        {
            msgid => '"inactive"',
        },
        {
            msgid => '"Inside block"',
        },
    );

    for (my $i = 0; $i < @expected; $i++) {
        for my $key (qw(msgid msgid_plural msgctxt)) {
            my $expected = $expected[$i]->{$key};
            my $expected_str = defined $expected ? $expected : 'not defined';
            is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
        }
    }
}




Section:
    Subsection:
        -
            - pref: SamplePref
              choices:
                on: Do
                off: Do not do
            - that thing
        -
            - pref: MultiplePref
              multiple:
                foo: Foo ツ
                bar: Bar
                baz: Baz

Lines 1-6 Link Here

(-)a/t/LangInstaller/templates/simple.tt (-1 / +1 lines)
1	[% USE raw %]	1	[% USE raw %]
2	[% PROCESS 'i18n.inc' %]	2	[% PROCESS 'i18n.inc' %]
3	[% t('hello') \| $raw %]	3	[% t('hello ツ') \| $raw %]
4	[% tx('hello {name}', { name = 'Bob' }) \| $raw %]	4	[% tx('hello {name}', { name = 'Bob' }) \| $raw %]
5	[% tn('item', 'items', count) \| $raw %]	5	[% tn('item', 'items', count) \| $raw %]
6	[% tnx('{count} item', '{count} items', count, { count = count }) \| $raw %]	6	[% tnx('{count} item', '{count} items', count, { count = count }) \| $raw %]




description:
  - "Sample installer file"

tables:
  - table1:
        translatable: [ column1, column2 ]
        multiline: [ column2 ]
        rows:
          - column1: foo ツ
            column2:
              - bar
              - baz
            column3: qux
            column4:
              - quux




#!/usr/bin/perl

use Modern::Perl;

use File::Slurp;
use File::Temp qw(tempdir);
use FindBin qw($Bin);
use Locale::PO;
use Test::More tests => 4;

my $tempdir = tempdir(CLEANUP => 1);

write_file("$tempdir/files", "$Bin/sample.yml");

my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-installer "
    . "-o $tempdir/Koha.pot -f $tempdir/files";

system($xgettext_cmd);
my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");

my @expected = (
    { msgid => '"Sample installer file"' },
    { msgid => '"bar"' },
    { msgid => '"baz"' },
    { msgid => '"foo ツ"' },
);

for (my $i = 0; $i < @expected; $i++) {
    my $expected = $expected[$i]->{msgid};
    my $expected_str = defined $expected ? $expected : 'not defined';
    is($pot->[$i + 1]->msgid, $expected, "$i: msgid is $expected_str");
}




#!/usr/bin/perl

use Modern::Perl;

use File::Slurp;
use File::Temp qw(tempdir);
use FindBin qw($Bin);
use Locale::PO;
use Test::More tests => 16;

my $tempdir = tempdir(CLEANUP => 1);

write_file("$tempdir/files", "$Bin/sample.pref");

my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-pref "
    . "-o $tempdir/Koha.pot -f $tempdir/files";

system($xgettext_cmd);
my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");

my @expected = (
    {
        msgid => '"Section"',
    },
    {
        msgctxt => '"Section > Subsection > MultiplePref"',
        msgid => '"Bar"',
    },
    {
        msgctxt => '"Section > Subsection > MultiplePref"',
        msgid => '"Baz"',
    },
    {
        msgctxt => '"Section > Subsection > MultiplePref"',
        msgid => '"Foo ツ"',
    },
    {
        msgctxt => '"Section > Subsection > SamplePref"',
        msgid => '"Do"',
    },
    {
        msgctxt => '"Section > Subsection > SamplePref"',
        msgid => '"Do not do"',
    },
    {
        msgctxt => '"Section > Subsection > SamplePref"',
        msgid => '"that thing"',
    },
    {
        msgctxt => '"Section"',
        msgid => '"Subsection"',
    },
);

for (my $i = 0; $i < @expected; $i++) {
    for my $key (qw(msgid msgctxt)) {
        my $expected = $expected[$i]->{$key};
        my $expected_str = defined $expected ? $expected : 'not defined';
        is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
    }
}




#!/usr/bin/perl

use Modern::Perl;

use File::Slurp;
use File::Temp qw(tempdir);
use FindBin qw($Bin);
use Locale::PO;
use Test::More tests => 36;

my $tempdir = tempdir(CLEANUP => 1);

write_file("$tempdir/files", "$Bin/sample.tt");

my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-tt2 --from-code=UTF-8 "
    . "-o $tempdir/Koha.pot -f $tempdir/files";

system($xgettext_cmd);
my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");

my @expected = (
    {
        msgid => '"hello ツ"',
    },
    {
        msgid => '"hello {name}"',
    },
    {
        msgid => '"item"',
        msgid_plural => '"items"',
    },
    {
        msgid => '"{count} item"',
        msgid_plural => '"{count} items"',
    },
    {
        msgid => '"hello"',
        msgctxt => '"context"',
    },
    {
        msgid => '"hello {name}"',
        msgctxt => '"context"',
    },
    {
        msgid => '"item"',
        msgid_plural => '"items"',
        msgctxt => '"context"',
    },
    {
        msgid => '"{count} item"',
        msgid_plural => '"{count} items"',
        msgctxt => '"context"',
    },
    {
        msgid => '"status is {status}"',
    },
    {
        msgid => '"active"',
    },
    {
        msgid => '"inactive"',
    },
    {
        msgid => '"Inside block"',
    },
);

for (my $i = 0; $i < @expected; $i++) {
    for my $key (qw(msgid msgid_plural msgctxt)) {
        my $expected = $expected[$i]->{$key};
        my $expected_str = defined $expected ? $expected : 'not defined';
        is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
    }
}

Lines 1522-1527 gulp-cli@^2.2.0: Link Here

(-)a/yarn.lock (-7 / +109 lines)
1522	v8flags "^3.2.0"	1522	v8flags "^3.2.0"
1523	yargs "^7.1.0"	1523	yargs "^7.1.0"
1524		1524
		1525	gulp-concat-po@^1.0.0:
		1526	version "1.0.0"
		1527	resolved "https://registry.yarnpkg.com/gulp-concat-po/-/gulp-concat-po-1.0.0.tgz#2fe7b2c12e45a566238e228f63396838013770ae"
		1528	integrity sha512-hFDZrUJcpw10TW3BfptL5W2FV/aMo3M+vxz9YQV4nlMBDAi8gs9/yZYZcYMYfl5XKhjpebSef8nyruoWdlX8Hw==
		1529	dependencies:
		1530	lodash.find "^4.6.0"
		1531	lodash.merge "^4.6.2"
		1532	lodash.uniq "^4.5.0"
		1533	plugin-error "^1.0.1"
		1534	pofile "^1.1.0"
		1535	through2 "^0.6.5"
		1536	vinyl "^2.2.0"
		1537
1525	gulp-cssnano@^2.1.2:	1538	gulp-cssnano@^2.1.2:
1526	version "2.1.3"	1539	version "2.1.3"
1527	resolved "https://registry.yarnpkg.com/gulp-cssnano/-/gulp-cssnano-2.1.3.tgz#02007e2817af09b3688482b430ad7db807aebf72"	1540	resolved "https://registry.yarnpkg.com/gulp-cssnano/-/gulp-cssnano-2.1.3.tgz#02007e2817af09b3688482b430ad7db807aebf72"
Lines 1533-1538 gulp-cssnano@^2.1.2: Link Here
1533	plugin-error "^1.0.1"	1546	plugin-error "^1.0.1"
1534	vinyl-sourcemaps-apply "^0.2.1"	1547	vinyl-sourcemaps-apply "^0.2.1"
1535		1548
		1549	gulp-exec@^4.0.0:
		1550	version "4.0.0"
		1551	resolved "https://registry.yarnpkg.com/gulp-exec/-/gulp-exec-4.0.0.tgz#4b6b67be0200d620143f3198a64257b68b146bb6"
		1552	integrity sha512-A9JvTyB3P4huusd/43bTr6SDg3MqBxL9AQbLnsKSO6/91wVkHfxgeJZlgDMkqK8sMel4so8wcko4SZOeB1UCgA==
		1553	dependencies:
		1554	lodash.template "^4.4.0"
		1555	plugin-error "^1.0.1"
		1556	through2 "^3.0.1"
		1557
1536	gulp-rename@^2.0.0:	1558	gulp-rename@^2.0.0:
1537	version "2.0.0"	1559	version "2.0.0"
1538	resolved "https://registry.yarnpkg.com/gulp-rename/-/gulp-rename-2.0.0.tgz#9bbc3962b0c0f52fc67cd5eaff6c223ec5b9cf6c"	1560	resolved "https://registry.yarnpkg.com/gulp-rename/-/gulp-rename-2.0.0.tgz#9bbc3962b0c0f52fc67cd5eaff6c223ec5b9cf6c"
Lines 2205-2210 lodash.escape@^3.0.0: Link Here
2205	dependencies:	2227	dependencies:
2206	lodash._root "^3.0.0"	2228	lodash._root "^3.0.0"
2207		2229
		2230	lodash.find@^4.6.0:
		2231	version "4.6.0"
		2232	resolved "https://registry.yarnpkg.com/lodash.find/-/lodash.find-4.6.0.tgz#cb0704d47ab71789ffa0de8b97dd926fb88b13b1"
		2233	integrity sha1-ywcE1Hq3F4n/oN6Ll92Sb7iLE7E=
		2234
2208	lodash.isarguments@^3.0.0:	2235	lodash.isarguments@^3.0.0:
2209	version "3.1.0"	2236	version "3.1.0"
2210	resolved "https://registry.yarnpkg.com/lodash.isarguments/-/lodash.isarguments-3.1.0.tgz#2f573d85c6a24289ff00663b491c1d338ff3458a"	2237	resolved "https://registry.yarnpkg.com/lodash.isarguments/-/lodash.isarguments-3.1.0.tgz#2f573d85c6a24289ff00663b491c1d338ff3458a"
Lines 2229-2234 lodash.memoize@^4.1.2: Link Here
2229	resolved "https://registry.yarnpkg.com/lodash.memoize/-/lodash.memoize-4.1.2.tgz#bcc6c49a42a2840ed997f323eada5ecd182e0bfe"	2256	resolved "https://registry.yarnpkg.com/lodash.memoize/-/lodash.memoize-4.1.2.tgz#bcc6c49a42a2840ed997f323eada5ecd182e0bfe"
2230	integrity sha1-vMbEmkKihA7Zl/Mj6tpezRguC/4=	2257	integrity sha1-vMbEmkKihA7Zl/Mj6tpezRguC/4=
2231		2258
		2259	lodash.merge@^4.6.2:
		2260	version "4.6.2"
		2261	resolved "https://registry.yarnpkg.com/lodash.merge/-/lodash.merge-4.6.2.tgz#558aa53b43b661e1925a0afdfa36a9a1085fe57a"
		2262	integrity sha512-0KpjqXRVvrYyCsX1swR/XTK0va6VQkQM6MNo7PqW77ByjAhoARA8EfrP1N4+KlKj8YS0ZUCtRT/YUuhyYDujIQ==
		2263
2232	lodash.restparam@^3.0.0:	2264	lodash.restparam@^3.0.0:
2233	version "3.6.1"	2265	version "3.6.1"
2234	resolved "https://registry.yarnpkg.com/lodash.restparam/-/lodash.restparam-3.6.1.tgz#936a4e309ef330a7645ed4145986c85ae5b20805"	2266	resolved "https://registry.yarnpkg.com/lodash.restparam/-/lodash.restparam-3.6.1.tgz#936a4e309ef330a7645ed4145986c85ae5b20805"
Lines 2249-2254 lodash.template@^3.0.0: Link Here
2249	lodash.restparam "^3.0.0"	2281	lodash.restparam "^3.0.0"
2250	lodash.templatesettings "^3.0.0"	2282	lodash.templatesettings "^3.0.0"
2251		2283
		2284	lodash.template@^4.4.0:
		2285	version "4.5.0"
		2286	resolved "https://registry.yarnpkg.com/lodash.template/-/lodash.template-4.5.0.tgz#f976195cf3f347d0d5f52483569fe8031ccce8ab"
		2287	integrity sha512-84vYFxIkmidUiFxidA/KjjH9pAycqW+h980j7Fuz5qxRtO9pgB7MDFTdys1N7A5mcucRiDyEq4fusljItR1T/A==
		2288	dependencies:
		2289	lodash._reinterpolate "^3.0.0"
		2290	lodash.templatesettings "^4.0.0"
		2291
2252	lodash.templatesettings@^3.0.0:	2292	lodash.templatesettings@^3.0.0:
2253	version "3.1.1"	2293	version "3.1.1"
2254	resolved "https://registry.yarnpkg.com/lodash.templatesettings/-/lodash.templatesettings-3.1.1.tgz#fb307844753b66b9f1afa54e262c745307dba8e5"	2294	resolved "https://registry.yarnpkg.com/lodash.templatesettings/-/lodash.templatesettings-3.1.1.tgz#fb307844753b66b9f1afa54e262c745307dba8e5"
Lines 2257-2262 lodash.templatesettings@^3.0.0: Link Here
2257	lodash._reinterpolate "^3.0.0"	2297	lodash._reinterpolate "^3.0.0"
2258	lodash.escape "^3.0.0"	2298	lodash.escape "^3.0.0"
2259		2299
		2300	lodash.templatesettings@^4.0.0:
		2301	version "4.2.0"
		2302	resolved "https://registry.yarnpkg.com/lodash.templatesettings/-/lodash.templatesettings-4.2.0.tgz#e481310f049d3cf6d47e912ad09313b154f0fb33"
		2303	integrity sha512-stgLz+i3Aa9mZgnjr/O+v9ruKZsPsndy7qPZOchbqk2cnTU1ZaldKK+v7m54WoKIyxiuMZTKT2H81F8BeAc3ZQ==
		2304	dependencies:
		2305	lodash._reinterpolate "^3.0.0"
		2306
2260	lodash.uniq@^4.5.0:	2307	lodash.uniq@^4.5.0:
2261	version "4.5.0"	2308	version "4.5.0"
2262	resolved "https://registry.yarnpkg.com/lodash.uniq/-/lodash.uniq-4.5.0.tgz#d0225373aeb652adc1bc82e4945339a842754773"	2309	resolved "https://registry.yarnpkg.com/lodash.uniq/-/lodash.uniq-4.5.0.tgz#d0225373aeb652adc1bc82e4945339a842754773"
Lines 2359-2364 meow@^3.7.0: Link Here
2359	redent "^1.0.0"	2406	redent "^1.0.0"
2360	trim-newlines "^1.0.0"	2407	trim-newlines "^1.0.0"
2361		2408
		2409	merge-stream@^2.0.0:
		2410	version "2.0.0"
		2411	resolved "https://registry.yarnpkg.com/merge-stream/-/merge-stream-2.0.0.tgz#52823629a14dd00c9770fb6ad47dc6310f2c1f60"
		2412	integrity sha512-abv/qOcuPfk3URPfDzmZU1LKmuw8kT+0nIHvKrKgFrwifol/doWcdA4ZqsWQ8ENrFKkd67Mfpo/LovbIUsbt3w==
		2413
2362	micromatch@^3.0.4, micromatch@^3.1.10, micromatch@^3.1.4:	2414	micromatch@^3.0.4, micromatch@^3.1.10, micromatch@^3.1.4:
2363	version "3.1.10"	2415	version "3.1.10"
2364	resolved "https://registry.yarnpkg.com/micromatch/-/micromatch-3.1.10.tgz#70859bc95c9840952f359a068a3fc49f9ecfac23"	2416	resolved "https://registry.yarnpkg.com/micromatch/-/micromatch-3.1.10.tgz#70859bc95c9840952f359a068a3fc49f9ecfac23"
Lines 2842-2847 plugin-error@^1.0.1: Link Here
2842	arr-union "^3.1.0"	2894	arr-union "^3.1.0"
2843	extend-shallow "^3.0.2"	2895	extend-shallow "^3.0.2"
2844		2896
		2897	pofile@^1.1.0:
		2898	version "1.1.0"
		2899	resolved "https://registry.yarnpkg.com/pofile/-/pofile-1.1.0.tgz#9ce84bbef5043ceb4f19bdc3520d85778fad4f94"
		2900	integrity sha512-6XYcNkXWGiJ2CVXogTP7uJ6ZXQCldYLZc16wgRp8tqRaBTTyIfF+TUT3EQJPXTLAT7OTPpTAoaFdoXKfaTRU1w==
		2901
2845	posix-character-classes@^0.1.0:	2902	posix-character-classes@^0.1.0:
2846	version "0.1.1"	2903	version "0.1.1"
2847	resolved "https://registry.yarnpkg.com/posix-character-classes/-/posix-character-classes-0.1.1.tgz#01eac0fe3b5af71a2a6c02feabb8c1fef7e00eab"	2904	resolved "https://registry.yarnpkg.com/posix-character-classes/-/posix-character-classes-0.1.1.tgz#01eac0fe3b5af71a2a6c02feabb8c1fef7e00eab"
Lines 3177-3182 read-pkg@^1.0.0: Link Here
3177	normalize-package-data "^2.3.2"	3234	normalize-package-data "^2.3.2"
3178	path-type "^1.0.0"	3235	path-type "^1.0.0"
3179		3236
		3237	"readable-stream@2 \|\| 3":
		3238	version "3.6.0"
		3239	resolved "https://registry.yarnpkg.com/readable-stream/-/readable-stream-3.6.0.tgz#337bbda3adc0706bd3e024426a286d4b4b2c9198"
		3240	integrity sha512-BViHy7LKeTz4oNnkcLJ+lVSL6vpiFeX6/d3oSH8zCW7UxP2onchk+vTGB143xuFjHS3deTgkKoXXymXqymiIdA==
		3241	dependencies:
		3242	inherits "^2.0.3"
		3243	string_decoder "^1.1.1"
		3244	util-deprecate "^1.0.1"
		3245
		3246	"readable-stream@>=1.0.33-1 <1.1.0-0":
		3247	version "1.0.34"
		3248	resolved "https://registry.yarnpkg.com/readable-stream/-/readable-stream-1.0.34.tgz#125820e34bc842d2f2aaafafe4c2916ee32c157c"
		3249	integrity sha1-Elgg40vIQtLyqq+v5MKRbuMsFXw=
		3250	dependencies:
		3251	core-util-is "~1.0.0"
		3252	inherits "~2.0.1"
		3253	isarray "0.0.1"
		3254	string_decoder "~0.10.x"
		3255
3180	readable-stream@^2.0.0, readable-stream@^2.0.1, readable-stream@^2.0.2, readable-stream@^2.0.5, readable-stream@^2.0.6, readable-stream@^2.1.5, readable-stream@^2.2.2, readable-stream@^2.3.3, readable-stream@^2.3.5, readable-stream@^2.3.6, readable-stream@~2.3.6:	3256	readable-stream@^2.0.0, readable-stream@^2.0.1, readable-stream@^2.0.2, readable-stream@^2.0.5, readable-stream@^2.0.6, readable-stream@^2.1.5, readable-stream@^2.2.2, readable-stream@^2.3.3, readable-stream@^2.3.5, readable-stream@^2.3.6, readable-stream@~2.3.6:
3181	version "2.3.7"	3257	version "2.3.7"
3182	resolved "https://registry.yarnpkg.com/readable-stream/-/readable-stream-2.3.7.tgz#1eca1cf711aef814c04f62252a36a62f6cb23b57"	3258	resolved "https://registry.yarnpkg.com/readable-stream/-/readable-stream-2.3.7.tgz#1eca1cf711aef814c04f62252a36a62f6cb23b57"
Lines 3293-3301 replace-ext@0.0.1: Link Here
3293	integrity sha1-KbvZIHinOfC8zitO5B6DeVNSKSQ=	3369	integrity sha1-KbvZIHinOfC8zitO5B6DeVNSKSQ=
3294		3370
3295	replace-ext@^1.0.0:	3371	replace-ext@^1.0.0:
3296	version "1.0.1"	3372	version "1.0.0"
3297	resolved "https://registry.yarnpkg.com/replace-ext/-/replace-ext-1.0.1.tgz#2d6d996d04a15855d967443631dd5f77825b016a"	3373	resolved "https://registry.yarnpkg.com/replace-ext/-/replace-ext-1.0.0.tgz#de63128373fcbf7c3ccfa4de5a480c45a67958eb"
3298	integrity sha512-yD5BHCe7quCgBph4rMQ+0KkIRKwWCrHDOX1p1Gp6HwjPM5kVoCdKGNhN7ydqqsX6lJEnQDKZ/tFMiEdQ1dvPEw==	3374	integrity sha1-3mMSg3P8v3w8z6TeWkgMRaZ5WOs=
3299		3375
3300	replace-homedir@^1.0.0:	3376	replace-homedir@^1.0.0:
3301	version "1.0.0"	3377	version "1.0.0"
Lines 3407-3412 safe-buffer@~5.1.0, safe-buffer@~5.1.1: Link Here
3407	resolved "https://registry.yarnpkg.com/safe-buffer/-/safe-buffer-5.1.2.tgz#991ec69d296e0313747d59bdfd2b745c35f8828d"	3483	resolved "https://registry.yarnpkg.com/safe-buffer/-/safe-buffer-5.1.2.tgz#991ec69d296e0313747d59bdfd2b745c35f8828d"
3408	integrity sha512-Gd2UZBJDkXlY7GbJxfsE8/nvKkUEU1G38c1siN6QP6a9PT9MmHB8GnpscSmMJSoF8LOIrt8ud/wPtojys4G6+g==	3484	integrity sha512-Gd2UZBJDkXlY7GbJxfsE8/nvKkUEU1G38c1siN6QP6a9PT9MmHB8GnpscSmMJSoF8LOIrt8ud/wPtojys4G6+g==
3409		3485
		3486	safe-buffer@~5.2.0:
		3487	version "5.2.0"
		3488	resolved "https://registry.yarnpkg.com/safe-buffer/-/safe-buffer-5.2.0.tgz#b74daec49b1148f88c64b68d49b1e815c1f2f519"
		3489	integrity sha512-fZEwUGbVl7kouZs1jCdMLdt95hdIv0ZeHg6L7qPeciMZhZ+/gdesW4wgTARkrFWEpspjEATAzUGPG8N2jJiwbg==
		3490
3410	safe-regex@^1.1.0:	3491	safe-regex@^1.1.0:
3411	version "1.1.0"	3492	version "1.1.0"
3412	resolved "https://registry.yarnpkg.com/safe-regex/-/safe-regex-1.1.0.tgz#40a3669f3b077d1e943d44629e157dd48023bf2e"	3493	resolved "https://registry.yarnpkg.com/safe-regex/-/safe-regex-1.1.0.tgz#40a3669f3b077d1e943d44629e157dd48023bf2e"
Lines 3668-3673 string-width@^3.0.0, string-width@^3.1.0: Link Here
3668	is-fullwidth-code-point "^2.0.0"	3749	is-fullwidth-code-point "^2.0.0"
3669	strip-ansi "^5.1.0"	3750	strip-ansi "^5.1.0"
3670		3751
		3752	string_decoder@^1.1.1:
		3753	version "1.3.0"
		3754	resolved "https://registry.yarnpkg.com/string_decoder/-/string_decoder-1.3.0.tgz#42f114594a46cf1a8e30b0a84f56c78c3edac21e"
		3755	integrity sha512-hkRX8U1WjJFd8LsDJ2yQ/wWWxaopEsABU1XfkM8A+j0+85JAGppt16cr1Whg6KIbb4okU6Mql6BOj+uup/wKeA==
		3756	dependencies:
		3757	safe-buffer "~5.2.0"
		3758
3671	string_decoder@~0.10.x:	3759	string_decoder@~0.10.x:
3672	version "0.10.31"	3760	version "0.10.31"
3673	resolved "https://registry.yarnpkg.com/string_decoder/-/string_decoder-0.10.31.tgz#62e203bc41766c6c28c9fc84301dab1c5310fa94"	3761	resolved "https://registry.yarnpkg.com/string_decoder/-/string_decoder-0.10.31.tgz#62e203bc41766c6c28c9fc84301dab1c5310fa94"
Lines 3790-3795 through2@2.X, through2@^2.0.0, through2@^2.0.3, through2@^2.0.5, through2@~2.0.0 Link Here
3790	readable-stream "~2.3.6"	3878	readable-stream "~2.3.6"
3791	xtend "~4.0.1"	3879	xtend "~4.0.1"
3792		3880
		3881	through2@^0.6.5:
		3882	version "0.6.5"
		3883	resolved "https://registry.yarnpkg.com/through2/-/through2-0.6.5.tgz#41ab9c67b29d57209071410e1d7a7a968cd3ad48"
		3884	integrity sha1-QaucZ7KdVyCQcUEOHXp6lozTrUg=
		3885	dependencies:
		3886	readable-stream ">=1.0.33-1 <1.1.0-0"
		3887	xtend ">=4.0.0 <4.1.0-0"
		3888
		3889	through2@^3.0.1:
		3890	version "3.0.1"
		3891	resolved "https://registry.yarnpkg.com/through2/-/through2-3.0.1.tgz#39276e713c3302edf9e388dd9c812dd3b825bd5a"
		3892	integrity sha512-M96dvTalPT3YbYLaKaCuwu+j06D/8Jfib0o/PxbVt6Amhv3dUAtW6rTV1jPgJSBG83I/e04Y6xkVdVhSRhi0ww==
		3893	dependencies:
		3894	readable-stream "2 \|\| 3"
		3895
3793	time-stamp@^1.0.0:	3896	time-stamp@^1.0.0:
3794	version "1.1.0"	3897	version "1.1.0"
3795	resolved "https://registry.yarnpkg.com/time-stamp/-/time-stamp-1.1.0.tgz#764a5a11af50561921b133f3b44e618687e0f5c3"	3898	resolved "https://registry.yarnpkg.com/time-stamp/-/time-stamp-1.1.0.tgz#764a5a11af50561921b133f3b44e618687e0f5c3"
Lines 3974-3980 use@^3.1.0: Link Here
3974	resolved "https://registry.yarnpkg.com/use/-/use-3.1.1.tgz#d50c8cac79a19fbc20f2911f56eb973f4e10070f"	4077	resolved "https://registry.yarnpkg.com/use/-/use-3.1.1.tgz#d50c8cac79a19fbc20f2911f56eb973f4e10070f"
3975	integrity sha512-cwESVXlO3url9YWlFW/TA9cshCEhtu7IKJ/p5soJ/gGpj7vbvFrAY/eIioQ6Dw23KjZhYgiIo8HOs1nQ2vr/oQ==	4078	integrity sha512-cwESVXlO3url9YWlFW/TA9cshCEhtu7IKJ/p5soJ/gGpj7vbvFrAY/eIioQ6Dw23KjZhYgiIo8HOs1nQ2vr/oQ==
3976		4079
3977	util-deprecate@~1.0.1:	4080	util-deprecate@^1.0.1, util-deprecate@~1.0.1:
3978	version "1.0.2"	4081	version "1.0.2"
3979	resolved "https://registry.yarnpkg.com/util-deprecate/-/util-deprecate-1.0.2.tgz#450d4dc9fa70de732762fbd2d4a28981419a0ccf"	4082	resolved "https://registry.yarnpkg.com/util-deprecate/-/util-deprecate-1.0.2.tgz#450d4dc9fa70de732762fbd2d4a28981419a0ccf"
3980	integrity sha1-RQ1Nyfpw3nMnYvvS1KKJgUGaDM8=	4083	integrity sha1-RQ1Nyfpw3nMnYvvS1KKJgUGaDM8=
Lines 4070-4076 vinyl@^0.5.0: Link Here
4070	clone-stats "^0.0.1"	4173	clone-stats "^0.0.1"
4071	replace-ext "0.0.1"	4174	replace-ext "0.0.1"
4072		4175
4073	vinyl@^2.0.0:	4176	vinyl@^2.0.0, vinyl@^2.2.0:
4074	version "2.2.0"	4177	version "2.2.0"
4075	resolved "https://registry.yarnpkg.com/vinyl/-/vinyl-2.2.0.tgz#d85b07da96e458d25b2ffe19fece9f2caa13ed86"	4178	resolved "https://registry.yarnpkg.com/vinyl/-/vinyl-2.2.0.tgz#d85b07da96e458d25b2ffe19fece9f2caa13ed86"
4076	integrity sha512-MBH+yP0kC/GQ5GwBqrTPTzEfiiLjta7hTtvQtbxBgTeSXsmKQRQecjibMbxIXzVT3Y9KJK+drOz1/k+vsu8Nkg==	4179	integrity sha512-MBH+yP0kC/GQ5GwBqrTPTzEfiiLjta7hTtvQtbxBgTeSXsmKQRQecjibMbxIXzVT3Y9KJK+drOz1/k+vsu8Nkg==
Lines 4133-4139 wrappy@1: Link Here
4133	resolved "https://registry.yarnpkg.com/wrappy/-/wrappy-1.0.2.tgz#b5243d8f3ec1aa35f1364605bc0d1036e30ab69f"	4236	resolved "https://registry.yarnpkg.com/wrappy/-/wrappy-1.0.2.tgz#b5243d8f3ec1aa35f1364605bc0d1036e30ab69f"
4134	integrity sha1-tSQ9jz7BqjXxNkYFvA0QNuMKtp8=	4237	integrity sha1-tSQ9jz7BqjXxNkYFvA0QNuMKtp8=
4135		4238
4136	xtend@~4.0.0, xtend@~4.0.1:	4239	"xtend@>=4.0.0 <4.1.0-0", xtend@~4.0.0, xtend@~4.0.1:
4137	version "4.0.2"	4240	version "4.0.2"
4138	resolved "https://registry.yarnpkg.com/xtend/-/xtend-4.0.2.tgz#bb72779f5fa465186b1f438f674fa347fdb5db54"	4241	resolved "https://registry.yarnpkg.com/xtend/-/xtend-4.0.2.tgz#bb72779f5fa465186b1f438f674fa347fdb5db54"
4139	integrity sha512-LKYU1iAXJXUgAXn9URjiu+MWhyUXHsvfp7mcuYm9dSUKK0/CjtrUwFAxD82/mCWbtLsGjFIad0wIsod4zrTAEQ==	4242	integrity sha512-LKYU1iAXJXUgAXn9URjiu+MWhyUXHsvfp7mcuYm9dSUKK0/CjtrUwFAxD82/mCWbtLsGjFIad0wIsod4zrTAEQ==
4140	-

Return to bug 25067

Lines 1-6 Link Here

(-)a/t/LangInstaller/templates/simple.tt (-1 / +1 lines)
1	[% USE raw %]	1	[% USE raw %]
2	[% PROCESS 'i18n.inc' %]	2	[% PROCESS 'i18n.inc' %]
3	[% t('hello') \| $raw %]	3	[% t('hello ツ') \| $raw %]
4	[% tx('hello {name}', { name = 'Bob' }) \| $raw %]	4	[% tx('hello {name}', { name = 'Bob' }) \| $raw %]
5	[% tn('item', 'items', count) \| $raw %]	5	[% tn('item', 'items', count) \| $raw %]
6	[% tnx('{count} item', '{count} items', count, { count = count }) \| $raw %]	6	[% tnx('{count} item', '{count} items', count, { count = count }) \| $raw %]

Lines 143-148 recommends 'Gravatar::URL', '1.03'; Link Here

(-)a/cpanfile (-1 / +1 lines)
143	recommends 'HTTPD::Bench::ApacheBench', '0.73';	143	recommends 'HTTPD::Bench::ApacheBench', '0.73';
144	recommends 'LWP::Protocol::https', '5.836';	144	recommends 'LWP::Protocol::https', '5.836';
145	recommends 'Lingua::Ispell', '0.07';	145	recommends 'Lingua::Ispell', '0.07';
		146	recommends 'Locale::XGettext::TT2', '0.7';
146	recommends 'Module::Bundled::Files', '0.03';	147	recommends 'Module::Bundled::Files', '0.03';
147	recommends 'Module::Load::Conditional', '0.38';	148	recommends 'Module::Load::Conditional', '0.38';
148	recommends 'Module::Pluggable', '3.9';	149	recommends 'Module::Pluggable', '3.9';
Lines 154-160 recommends 'Net::SFTP::Foreign', '1.73'; Link Here
154	recommends 'Net::Server', '0.97';	155	recommends 'Net::Server', '0.97';
155	recommends 'Net::Z3950::SimpleServer', '1.15';	156	recommends 'Net::Z3950::SimpleServer', '1.15';
156	recommends 'PDF::FromHTML', '0.31';	157	recommends 'PDF::FromHTML', '0.31';
157	recommends 'PPI', '1.215';
158	recommends 'Parallel::ForkManager', '0.75';	158	recommends 'Parallel::ForkManager', '0.75';
159	recommends 'Readonly', '0.01';	159	recommends 'Readonly', '0.01';
160	recommends 'Readonly::XS', '0.01';	160	recommends 'Readonly::XS', '0.01';

Line 0 Link Here

(-)a/docs/development/internationalization.md (+121 lines)
		1	# Internationalization
		2
		3	This page documents how internationalization works in Koha.
		4
		5	## Making strings translatable
		6
		7	There are several ways of making a string translatable, depending on where it
		8	is located
		9
		10	### In Template::Toolkit files (`*.tt`)
		11
		12	The simplest way to make a string translatable in a template is to do nothing.
		13	Templates are parsed as HTML files and almost all text nodes are considered as
		14	translatable strings. This also includes some attributes like `title` and
		15	`placeholder`.
		16
		17	This method has some downsides: you don't have full control over what would
		18	appear in PO files and you cannot use plural forms or context. In order to do
		19	that you have to use `i18n.inc`
		20
		21	`i18n.inc` contains several macros that, when used, make a string translatable.
		22	The first thing to do is to make these macros available by adding
		23
		24	[% PROCESS 'i18n.inc' %]
		25
		26	at the top of the template file. Then you can use those macros.
		27
		28	The simplest one is `t(msgid)`
		29
		30	[% t('This is a translatable string') %]
		31
		32	You can also use variable substitution with `tx(msgid, vars)`
		33
		34	[% tx('Hello, {name}', { name = 'World' }) %]
		35
		36	You can use plural forms with `tn(msgid, msgid_plural, count)`
		37
		38	[% tn('a child', 'several children', number_of_children) %]
		39
		40	You can add context, to help translators when a term is ambiguous, with
		41	`tp(msgctxt, msgid)`
		42
		43	[% tp('verb', 'order') %]
		44	[% tp('noun', 'order') %]
		45
		46	Or any combinations of the above
		47
		48	[% tnpx('bibliographic record', '{count} item', '{count} items', items_count, { count = items_count }) %]
		49
		50	### In JavaScript files (`*.js`)
		51
		52	Like in templates, you have several functions available. Just replace `t` by `__`.
		53
		54	__('This is a translatable string');
		55	__npx('bibliographic record, '{count} item', '{count} items', items_count, { count: items_count });
		56
		57	### In Perl files (`.pl`, `.pm`)
		58
		59	You will have to add
		60
		61	use Koha::I18N;
		62
		63	at the top of the file, and then the same functions as above will be available.
		64
65	__('This is a translatable string');
66	__npx('bibliographic record, '{count} item', '{count} items', $items_count, count => $items_count);
67
68	### In installer and preferences YAML files (`*.yml`)
69
70	Nothing special to do here. All strings will be automatically translatable.
71
72	## Manipulating PO files
73
74	Once strings have been made translatable in source files, they have to be
75	extracted into PO files and uploaded on https://translate.koha-community.org/
76	so they can be translated.
77
78	### Install gulp first
79
80	The next sections rely on gulp. If it's not installed, run the following
81	commands:
82
83	# as root
84	npm install gulp-cli -g
85
86	# as normal user, from the root of Koha repository
87	yarn
88
89	### Create PO files for a new language
90
91	If you want to add translations for a new language, you have to create the
92	missing PO files. You can do that by executing the following command:
93
94	# Replace xx-XX by your language tag
95	gulp po:create --lang xx-XX
96
97	New PO files will be available in `misc/translator/po`.
98
99	### Update PO files with new strings
100
101	When new features or bugfixes are added to Koha, new translatable strings can
102	be added, other can be removed or modified, and the PO file become out of sync.
103
104	To be able to translate the new or modified strings, you have to update PO
105	files. This can be done by executing the following command:
106
107	# Update PO files for all languages
108	gulp po:update
109
110	# or only one language
111	gulp po:update --lang xx-XX
112
113	### Only extract strings
114
115	Creating or updating PO files automatically extract strings, but if for some
116	reasons you want to only extract strings without touching PO files, you can run
117	the following command:
118
119	gulp po:extract
120
121	POT files will be available in `misc/translator`.

Lines 204-214 sub usage { Link Here

(-)a/misc/translator/tmpl_process3.pl (-119 / +3 lines)
204	my($exitcode) = @_;	204	my($exitcode) = @_;
205	my $h = $exitcode? STDERR: STDOUT;	205	my $h = $exitcode? STDERR: STDOUT;
206	print $h <<EOF;	206	print $h <<EOF;
207	Usage: $0 create [OPTION]	207	Usage: $0 install [OPTION]
208	or: $0 update [OPTION]
209	or: $0 install [OPTION]
210	or: $0 --help	208	or: $0 --help
211	Create or update PO files from templates, or install translated templates.	209	Install translated templates.
212		210
213	-i, --input=SOURCE Get or update strings from SOURCE directory(s).	211	-i, --input=SOURCE Get or update strings from SOURCE directory(s).
214	On create or update can have multiple values.	212	On create or update can have multiple values.
Lines 230-236 Create or update PO files from templates, or install translated templates. Link Here
230	--help Display this help and exit	228	--help Display this help and exit
231	-q, --quiet no output to screen (except for errors)	229	-q, --quiet no output to screen (except for errors)
232		230
233	The -o option is ignored for the "create" and "update" actions.
234	Try `perldoc $0` for perhaps more information.	231	Try `perldoc $0` for perhaps more information.
235	EOF	232	EOF
236	exit($exitcode);	233	exit($exitcode);
Lines 265-276 GetOptions( Link Here
265	VerboseWarnings::set_application_name($0);	262	VerboseWarnings::set_application_name($0);
266	VerboseWarnings::set_pedantic_mode($pedantic_p);	263	VerboseWarnings::set_pedantic_mode($pedantic_p);
267		264
268	# keep the buggy Locale::PO quiet if it says stupid things
269	$SIG{__WARN__} = sub {
270	my($s) = @_;
271	print STDERR $s unless $s =~ /^Strange line in [^:]+: #~/s
272	};
273
274	my $action = shift or usage_error('You must specify an ACTION.');	265	my $action = shift or usage_error('You must specify an ACTION.');
275	usage_error('You must at least specify input and string list filenames.')	266	usage_error('You must at least specify input and string list filenames.')
276	if !@in_dirs \|\| !defined $str_file;	267	if !@in_dirs \|\| !defined $str_file;
Lines 344-432 if (!defined $charset_out) { Link Here
344	$charset_out = TmplTokenizer::charset_canon('UTF-8');	335	$charset_out = TmplTokenizer::charset_canon('UTF-8');
345	warn "Warning: Charset Out defaulting to $charset_out\n" unless ( $quiet );	336	warn "Warning: Charset Out defaulting to $charset_out\n" unless ( $quiet );
346	}	337	}
347	my $xgettext = './xgettext.pl'; # actual text extractor script
348	my $st;	338	my $st;
349		339
350	if ($action eq 'create') {	340	if ($action eq 'install') {
351	# updates the list. As the list is empty, every entry will be added
352	if (!-s $str_file) {
353	warn "Removing empty file $str_file\n" unless ( $quiet );
354	unlink $str_file \|\| die "$str_file: $!\n";
355	}
356	die "$str_file: Output file already exists\n" if -f $str_file;
357	my($tmph1, $tmpfile1) = tmpnam();
358	my($tmph2, $tmpfile2) = tmpnam();
359	close $tmph2; # We just want a name
360	# Generate the temporary file that acts as <MODULE>/POTFILES.in
361	for my $input (@in_files) {
362	print $tmph1 "$input\n";
363	}
364	close $tmph1;
365	warn "I $charset_in O $charset_out" unless ( $quiet );
366	# Generate the specified po file ($str_file)
367	$st = system ($xgettext, '-s', '-f', $tmpfile1, '-o', $tmpfile2,
368	(defined $charset_in? ('-I', $charset_in): ()),
369	(defined $charset_out? ('-O', $charset_out): ())
370	);
371	# Run msgmerge so that the pot file looks like a real pot file
372	# We need to help msgmerge a bit by pre-creating a dummy po file that has
373	# the headers and the "" msgid & msgstr. It will fill in the rest.
374	if ($st == 0) {
375	# Merge the temporary "pot file" with the specified po file ($str_file)
376	# FIXME: msgmerge(1) is a Unix dependency
377	# FIXME: need to check the return value
378	unless (-f $str_file) {
379	open(my $infh, '<', $tmpfile2);
380	open(my $outfh, '>', $str_file);
381	while (<$infh>) {
382	print $outfh $_;
383	last if /^\n/s;
384	}
385	close $infh;
386	close $outfh;
387	}
388	$st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile2 -o - \| msgattrib --no-obsolete -o $str_file");
389	} else {
390	error_normal("Text extraction failed: $xgettext: $!\n", undef);
391	error_additional("Will not run msgmerge\n", undef);
392	}
393	unlink $tmpfile1 \|\| warn_normal("$tmpfile1: unlink failed: $!\n", undef);
394	unlink $tmpfile2 \|\| warn_normal("$tmpfile2: unlink failed: $!\n", undef);
395
396	} elsif ($action eq 'update') {
397	my($tmph1, $tmpfile1) = tmpnam();
398	my($tmph2, $tmpfile2) = tmpnam();
399	close $tmph2; # We just want a name
400	# Generate the temporary file that acts as <MODULE>/POTFILES.in
401	for my $input (@in_files) {
402	print $tmph1 "$input\n";
403	}
404	close $tmph1;
405	# Generate the temporary file that acts as <MODULE>/<LANG>.pot
406	$st = system($xgettext, '-s', '-f', $tmpfile1, '-o', $tmpfile2,
407	'--po-mode',
408	(defined $charset_in? ('-I', $charset_in): ()),
409	(defined $charset_out? ('-O', $charset_out): ()));
410	if ($st == 0) {
411	# Merge the temporary "pot file" with the specified po file ($str_file)
412	# FIXME: msgmerge(1) is a Unix dependency
413	# FIXME: need to check the return value
414	if ( @filenames ) {
415	my ($tmph3, $tmpfile3) = tmpnam();
416	$st = system("msgcat $str_file $tmpfile2 > $tmpfile3");
417	$st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile3 -o - \| msgattrib --no-obsolete -o $str_file")
418	unless $st;
419	} else {
420	$st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile2 -o - \| msgattrib --no-obsolete -o $str_file");
421	}
422	} else {
423	error_normal("Text extraction failed: $xgettext: $!\n", undef);
424	error_additional("Will not run msgmerge\n", undef);
425	}
426	unlink $tmpfile1 \|\| warn_normal("$tmpfile1: unlink failed: $!\n", undef);
427	unlink $tmpfile2 \|\| warn_normal("$tmpfile2: unlink failed: $!\n", undef);
428
429	} elsif ($action eq 'install') {
430	if(!defined($out_dir)) {	341	if(!defined($out_dir)) {
431	usage_error("You must specify an output directory when using the install method.");	342	usage_error("You must specify an output directory when using the install method.");
432	}	343	}
Lines 554-567 translation, it can be suppressed with the %0.0s notation. Link Here
554	Using the PO format also means translators can add their	465	Using the PO format also means translators can add their
555	own comments in the translation files, if necessary.	466	own comments in the translation files, if necessary.
556		467
557	=item -
558
559	Create, update, and install actions are all based on the
560	same scanner module. This ensures that update and install
561	have the same idea of what is a translatable string;
562	attribute names in tags, for example, will not be
563	accidentally translated.
564
565	=back	468	=back
566		469
567	=head1 NOTES	470	=head1 NOTES
Lines 569-590 accidentally translated. Link Here
569	Anchors are represented by an <AI<n>> notation.	472	Anchors are represented by an <AI<n>> notation.
570	The meaning of this non-standard notation might not be obvious.	473	The meaning of this non-standard notation might not be obvious.
571		474
572	The create action calls xgettext.pl to do the actual work;
573	the update action calls xgettext.pl, msgmerge(1) and msgattrib(1)
574	to do the actual work.
575
576	=head1 BUGS	475	=head1 BUGS
577		476
578	xgettext.pl must be present in the current directory; both
579	msgmerge(1) and msgattrib(1) must also be present in the search path.
580	The script currently does not check carefully whether these
581	dependent commands are present.
582
583	Locale::PO(3) has a lot of bugs. It can neither parse nor
584	generate GNU PO files properly; a couple of workarounds have
585	been written in TmplTokenizer and more is likely to be needed
586	(e.g., to get rid of the "Strange line" warning for #~).
587
588	This script may not work in Windows.	477	This script may not work in Windows.
589		478
590	There are probably some other bugs too, since this has not been	479	There are probably some other bugs too, since this has not been
Lines 592-603 tested very much. Link Here
592		481
593	=head1 SEE ALSO	482	=head1 SEE ALSO
594		483
595	xgettext.pl,
596	TmplTokenizer.pm,	484	TmplTokenizer.pm,
597	msgmerge(1),
598	Locale::PO(3),	485	Locale::PO(3),
599	translator_doc.txt
600
601	http://www.saas.nsw.edu.au/koha_wiki/index.php?page=DifficultTerms
602		486
603	=cut	487	=cut

Lines 54-67 usage() if $#ARGV != 1 && $#ARGV != 0; Link Here

(-)a/misc/translator/translate (-39 / +3 lines)
54		54
55	my ($cmd, $lang) = @ARGV;	55	my ($cmd, $lang) = @ARGV;
56	$cmd = lc $cmd;	56	$cmd = lc $cmd;
57	if ( $cmd =~ /^(create\|install\|update\|compress\|uncompress)$/ ) {	57	if ( $cmd =~ /^(install\|compress\|uncompress)$/ ) {
58	my $installer = LangInstaller->new( $lang, $pref, $verbose );	58	my $installer = LangInstaller->new( $lang, $pref, $verbose );
59	if ( $cmd ne 'create' and $lang and not grep( {$_ eq $lang} @{ $installer->{langs} } ) ) {	59	if ( $lang and not grep( {$_ eq $lang} @{ $installer->{langs} } ) ) {
60	print "Unsupported language: $lang\n";	60	print "Unsupported language: $lang\n";
61	exit;	61	exit;
62	}	62	}
63	if ( $all ) {	63	if ( $all ) {
64	usage() if $cmd eq 'create';
65	for my $lang ( @{$installer->{langs}} ) {	64	for my $lang ( @{$installer->{langs}} ) {
66	$installer->set_lang( $lang );	65	$installer->set_lang( $lang );
67	$installer->$cmd(\@files);	66	$installer->$cmd(\@files);
Lines 85-96 translate - Handle templates and preferences translation Link Here
85		84
86	=head1 SYNOPSYS	85	=head1 SYNOPSYS
87		86
88	translate create fr-FR
89	translate update fr-FR
90	translate install fr-FR	87	translate install fr-FR
91	translate install fr-FR -f search -f memberentry	88	translate install fr-FR -f search -f memberentry
92	translate -p install fr-FR	89	translate -p install fr-FR
93	translate install
94	translate compress [fr-FR]	90	translate compress [fr-FR]
95	translate uncompress [fr-FR]	91	translate uncompress [fr-FR]
96		92
Lines 98-104 translate - Handle templates and preferences translation Link Here
98		94
99	In Koha, three categories of information are translated based on standard GNU	95	In Koha, three categories of information are translated based on standard GNU
100	.po files: opac templates pages, intranet templates and system preferences. The	96	.po files: opac templates pages, intranet templates and system preferences. The
101	script is a wrapper. It allows to quickly create/update/install .po files for a	97	script is a wrapper. It allows to quickly install .po files for a
102	given language or for all available languages.	98	given language or for all available languages.
103		99
104	=head1 USAGE	100	=head1 USAGE
Lines 107-144 Use the -v or --verbose parameter to make translator more verbose. Link Here
107		103
108	=over	104	=over
109		105
110	=item translate create F<lang>
111
112	Create 3 .po files in F</misc/translator/po> subdirectory: (1) from opac pages
113	templates, (2) intranet templates, and (3) from preferences. English 'en'
114	version of templates and preferences are used as references.
115
116	=over
117
118	=item F<lang>-opac-{theme}.po
119
120	Contains extracted text from english (en) OPAC templates found in
121	<KOHA_ROOT>/koha-tmpl/opac-tmpl/{theme}/en/ directory.
122
123	=item F<lang>-intranet.po
124
125	Contains extracted text from english (en) intranet templates found in
126	<KOHA_ROOT>/koha-tmpl/intranet-tmpl/prog/en/ directory.
127
128	=item F<lang>-pref.po
129
130	Contains extracted text from english (en) preferences. They are found in files
131	located in <KOHA_ROOT>/koha-tmpl/intranet-tmpl/prog/en/admin/preferences
132	directory.
133
134	=back
135
136	=item translate [-p] update F<lang>
137
138	Update .po files in F<po> directory, named F<lang>-*.po. Without F<lang>, all
139	available languages are updated. With -p option, only preferences .po file is
140	updated.
141
142	=item translate [-p\|-f] install F<lang>	106	=item translate [-p\|-f] install F<lang>
143		107
144	Use .po files to translate the english version of templates and preferences files	108	Use .po files to translate the english version of templates and preferences files

Line 0 Link Here

(-)a/misc/translator/xgettext-installer (+143 lines)
		1	#!/usr/bin/perl
		2
		3	=head1 NAME
		4
		5	xgettext-installer - extract translatable strings from installer YAML files
		6
		7	=head1 SYNOPSIS
		8
		9	xgettext-installer [OPTION] [INPUTFILE]...
		10
		11	=head1 OPTIONS
		12
		13	=over
		14
		15	=item B<-f, --files-from=FILE>
		16
		17	get list of input files from FILE
		18
		19	=item B<-o, --output=FILE>
		20
		21	write output to the specified file
		22
		23	=item B<-h, --help>
		24
		25	display this help and exit
		26
		27	=back
		28
		29	=cut
		30
		31	use Modern::Perl;
		32
		33	use Getopt::Long;
		34	use Locale::PO;
		35	use Pod::Usage;
		36	use YAML::Syck qw(LoadFile);
		37
		38	$YAML::Syck::ImplicitTyping = 1;
		39
		40	my $output = 'messages.pot';
		41	my $files_from;
		42	my $help;
		43
		44	GetOptions(
		45	'output=s' => \$output,
		46	'files-from=s' => \$files_from,
		47	'help' => \$help,
		48	) or pod2usage(-verbose => 1, -exitval => 2);
		49
		50	if ($help) {
		51	pod2usage(-verbose => 1, -exitval => 0);
		52	}
		53
		54	my @files = @ARGV;
		55	if ($files_from) {
		56	open(my $fh, '<', $files_from) or die "Cannot open $files_from: $!";
		57	push @files, <$fh>;
		58	chomp @files;
		59	close $fh;
		60	}
		61
		62	my $pot = {
		63	'' => Locale::PO->new(
		64	-msgid => '',
65	-msgstr =>
66	"Project-Id-Version: Koha\n"
67	. "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
68	. "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\n"
69	. "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\n"
70	. "MIME-Version: 1.0\n"
71	. "Content-Type: text/plain; charset=UTF-8\n"
72	. "Content-Transfer-Encoding: 8bit\n"
73	),
74	};
75
76	for my $file (@files) {
77	my $yaml = LoadFile($file);
78	my @tables = @{ $yaml->{'tables'} };
79
80	my $tablec = 0;
81	for my $table (@tables) {
82	$tablec++;
83
84	my $table_name = ( keys %$table )[0];
85	my @translatable = @{ $table->{$table_name}->{translatable} };
86	my @rows = @{ $table->{$table_name}->{rows} };
87	my @multiline = @{ $table->{$table_name}->{'multiline'} };
88
89	my $rowc = 0;
90	for my $row (@rows) {
91	$rowc++;
92
93	for my $field (@translatable) {
94	if ( @multiline and grep { $_ eq $field } @multiline ) {
95	# multiline fields, only notices ATM
96	my $mulc;
97	foreach my $line ( @{ $row->{$field} } ) {
98	$mulc++;
99
100	# discard pure html, TT, empty
101	next if ( $line =~ /^(\s<.?>\s$\|^\s\[.?\]\s\|\s*)$/ );
102
103	# put placeholders
104	$line =~ s/(<<.?>>\|\[\%.?\%\]\|<.*?>)/\%s/g;
105
106	# discard non strings
107	next if ( $line =~ /^(\s\|%s\|-\|[[:punct:]]\|\(\|\))*$/ or length($line) < 2 );
108	if ( not $pot->{$line} ) {
109	my $msg = new Locale::PO(
110	-msgid => $line,
111	-msgstr => '',
112	-reference => "$file:$table_name:$tablec:row:$rowc:mul:$mulc"
113	);
114	$pot->{$line} = $msg;
115	}
116	}
117	} elsif (defined $row->{$field} && length($row->{$field}) > 1 && !$pot->{ $row->{$field} }) {
118	my $msg = new Locale::PO(
119	-msgid => $row->{$field},
120	-msgstr => '',
121	-reference => "$file:$table_name:$tablec:row:$rowc"
122	);
123	$pot->{ $row->{$field} } = $msg;
124	}
125	}
126	}
127	}
128
129	my $desccount = 0;
130	for my $description ( @{ $yaml->{'description'} } ) {
131	$desccount++;
132	if ( length($description) > 1 and not $pot->{$description} ) {
133	my $msg = new Locale::PO(
134	-msgid => $description,
135	-msgstr => '',
136	-reference => "$file:description:$desccount"
137	);
138	$pot->{$description} = $msg;
139	}
140	}
141	}
142
143	Locale::PO->save_file_fromhash($output, $pot);

Line 0 Link Here

(-)a/misc/translator/xgettext-pref (+134 lines)
		1	#!/usr/bin/perl
		2
		3	=head1 NAME
		4
		5	xgettext-pref - extract translatable strings from system preferences YAML files
		6
		7	=head1 SYNOPSIS
		8
		9	xgettext-pref [OPTION] [INPUTFILE]...
		10
		11	=head1 OPTIONS
		12
		13	=over
		14
		15	=item B<-f, --files-from=FILE>
		16
		17	get list of input files from FILE
		18
		19	=item B<-o, --output=FILE>
		20
		21	write output to the specified file
		22
		23	=item B<-h, --help>
		24
		25	display this help and exit
		26
		27	=back
		28
		29	=cut
		30
		31	use Modern::Perl;
		32
		33	use Getopt::Long;
		34	use Locale::PO;
		35	use Pod::Usage;
		36	use YAML::Syck qw(LoadFile);
		37
		38	$YAML::Syck::ImplicitTyping = 1;
		39
		40	my $output = 'messages.pot';
		41	my $files_from;
		42	my $help;
		43
		44	GetOptions(
		45	'output=s' => \$output,
		46	'files-from=s' => \$files_from,
		47	'help' => \$help,
		48	) or pod2usage(-verbose => 1, -exitval => 2);
		49
		50	if ($help) {
		51	pod2usage(-verbose => 1, -exitval => 0);
		52	}
		53
		54	my @files = @ARGV;
		55	if ($files_from) {
		56	open(my $fh, '<', $files_from) or die "Cannot open $files_from: $!";
		57	push @files, <$fh>;
		58	chomp @files;
		59	close $fh;
		60	}
		61
		62	my $pot = {
		63	'' => Locale::PO->new(
		64	-msgid => '',
65	-msgstr => "Project-Id-Version: Koha\n"
66	. "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
67	. "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\n"
68	. "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\n"
69	. "MIME-Version: 1.0\n"
70	. "Content-Type: text/plain; charset=UTF-8\n"
71	. "Content-Transfer-Encoding: 8bit\n"
72	),
73	};
74
75	for my $file (@files) {
76	my $pref = LoadFile($file);
77	while ( my ($tab, $tab_content) = each %$pref ) {
78	add_po($file, undef, $tab);
79
80	if ( ref($tab_content) eq 'ARRAY' ) {
81	add_prefs( $file, $tab, $tab_content );
82	} else {
83	while ( my ($section, $sysprefs) = each %$tab_content ) {
84	my $context = "$tab > $section";
85	add_po($file, $tab, $section);
86	add_prefs( $file, $context, $sysprefs );
87	}
88	}
89	}
90	}
91
92	Locale::PO->save_file_fromhash($output, $pot);
93
94	sub add_prefs {
95	my ($file, $context, $prefs) = @_;
96
97	for my $pref (@$prefs) {
98	my $pref_name = '';
99	for my $element (@$pref) {
100	if ( ref($element) eq 'HASH' ) {
101	$pref_name = $element->{pref};
102	last;
103	}
104	}
105	for my $element (@$pref) {
106	if ( ref($element) eq 'HASH' ) {
107	while ( my ( $key, $value ) = each(%$element) ) {
108	next unless $key eq 'choices' or $key eq 'multiple';
109	next unless ref($value) eq 'HASH';
110	for my $ckey ( keys %$value ) {
111	add_po( $file, "$context > $pref_name", $value->{$ckey} );
112	}
113	}
114	}
115	elsif ($element) {
116	add_po( $file, "$context > $pref_name", $element );
117	}
118	}
119	}
120	}
121
122	sub add_po {
123	my ( $reference, $msgctxt, $msgid ) = @_;
124
125	return unless $msgid;
126
127	my $key = ($msgctxt // '') . ";$msgid";
128	$pot->{$key} = Locale::PO->new(
129	-reference => $reference,
130	-msgctxt => $msgctxt,
131	-msgid => $msgid,
132	-msgstr => '',
133	);
134	}

Line 0 Link Here

(-)a/misc/translator/xgettext-tt2 (+41 lines)
	1	#!/usr/bin/perl
	2
	3	use Modern::Perl;
	4
	5	my $xgettext = Locale::XGettext::TT2::Koha->newFromArgv(\@ARGV);
	6	$xgettext->setOption('plug_in', '');
	7	$xgettext->run;
	8	$xgettext->output;
	9
	10	package Locale::XGettext::TT2::Koha;
	11
	12	use parent 'Locale::XGettext::TT2';
	13
	14	sub defaultKeywords {
	15	return [
	16	't:1',
	17	'tx:1',
	18	'tn:1,2',
	19	'tnx:1,2',
	20	'txn:1,2',
	21	'tp:1c,2',
	22	'tpx:1c,2',
	23	'tnp:1c,2,3',
	24	'tnpx:1c,2,3',
	25	];
	26	}
	27
	28	sub defaultFlags {
	29	return [
	30	'tx:1:perl-brace-format',
	31	'tnx:1:perl-brace-format',
	32	'tnx:2:perl-brace-format',
	33	'txn:1:perl-brace-format',
	34	'txn:2:perl-brace-format',
	35	'tpx:2:perl-brace-format',
	36	'tnpx:2:perl-brace-format',
	37	'tnpx:3:perl-brace-format',
	38	],
	39	}
	40
	41	1;

Lines 1-109 Link Here

(-)a/t/LangInstaller.t (-109 lines)
1	use Modern::Perl;
2
3	use FindBin '$Bin';
4	use lib "$Bin/../misc/translator";
5
6	use Test::More tests => 39;
7	use File::Temp qw(tempdir);
8	use File::Slurp;
9	use Locale::PO;
10
11	use t::lib::Mocks;
12
13	use_ok('LangInstaller');
14
15	my $installer = LangInstaller->new();
16
17	my $tempdir = tempdir(CLEANUP => 0);
18	t::lib::Mocks::mock_config('intrahtdocs', "$Bin/LangInstaller/templates");
19	my @files = ('simple.tt');
20	$installer->extract_messages_from_templates($tempdir, 'intranet', @files);
21
22	my $tempfile = "$tempdir/koha-tmpl/intranet-tmpl/simple.tt";
23	ok(-e $tempfile, 'it has created a temporary file simple.tt');
24	SKIP: {
25	skip "simple.tt does not exist", 37 unless -e $tempfile;
26
27	my $output = read_file($tempfile);
28	my $expected_output = <<'EOF';
29	__('hello');
30	__x('hello {name}');
31	__n('item', 'items');
32	__nx('{count} item', '{count} items');
33	__p('context', 'hello');
34	__px('context', 'hello {name}');
35	__np('context', 'item', 'items');
36	__npx('context', '{count} item', '{count} items');
37	__npx('context', '{count} item', '{count} items');
38	__x('status is {status}');
39	__('active');
40	__('inactive');
41	__('Inside block');
42	EOF
43
44	is($output, $expected_output, "Output of extract_messages_from_templates is as expected");
45
46	my $xgettext_cmd = "xgettext -L Perl --from-code=UTF-8 "
47	. "--package-name=Koha --package-version='' "
48	. "-k -k__ -k__x -k__n:1,2 -k__nx:1,2 -k__xn:1,2 -k__p:1c,2 "
49	. "-k__px:1c,2 -k__np:1c,2,3 -k__npx:1c,2,3 "
50	. "-o $tempdir/Koha.pot -D $tempdir koha-tmpl/intranet-tmpl/simple.tt";
51
52	system($xgettext_cmd);
53	my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");
54
55	my @expected = (
56	{
57	msgid => '"hello"',
58	},
59	{
60	msgid => '"hello {name}"',
61	},
62	{
63	msgid => '"item"',
64	msgid_plural => '"items"',
65	},
66	{
67	msgid => '"{count} item"',
68	msgid_plural => '"{count} items"',
69	},
70	{
71	msgid => '"hello"',
72	msgctxt => '"context"',
73	},
74	{
75	msgid => '"hello {name}"',
76	msgctxt => '"context"',
77	},
78	{
79	msgid => '"item"',
80	msgid_plural => '"items"',
81	msgctxt => '"context"',
82	},
83	{
84	msgid => '"{count} item"',
85	msgid_plural => '"{count} items"',
86	msgctxt => '"context"',
87	},
88	{
89	msgid => '"status is {status}"',
90	},
91	{
92	msgid => '"active"',
93	},
94	{
95	msgid => '"inactive"',
96	},
97	{
98	msgid => '"Inside block"',
99	},
100	);
101
102	for (my $i = 0; $i < @expected; $i++) {
103	for my $key (qw(msgid msgid_plural msgctxt)) {
104	my $expected = $expected[$i]->{$key};
105	my $expected_str = defined $expected ? $expected : 'not defined';
106	is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
107	}
108	}
109	}

Line 0 Link Here

(-)a/t/misc/translator/sample.pref (+14 lines)
	1	Section:
	2	Subsection:
	3	-
	4	- pref: SamplePref
	5	choices:
	6	on: Do
	7	off: Do not do
	8	- that thing
	9	-
	10	- pref: MultiplePref
	11	multiple:
	12	foo: Foo ツ
	13	bar: Bar
	14	baz: Baz

Line 0 Link Here

(-)a/t/misc/translator/sample.yml (+15 lines)
	1	description:
	2	- "Sample installer file"
	3
	4	tables:
	5	- table1:
	6	translatable: [ column1, column2 ]
	7	multiline: [ column2 ]
	8	rows:
	9	- column1: foo ツ
	10	column2:
	11	- bar
	12	- baz
	13	column3: qux
	14	column4:
	15	- quux

Line 0 Link Here

(-)a/t/misc/translator/xgettext-installer.t (+32 lines)
	1	#!/usr/bin/perl
	2
	3	use Modern::Perl;
	4
	5	use File::Slurp;
	6	use File::Temp qw(tempdir);
	7	use FindBin qw($Bin);
	8	use Locale::PO;
	9	use Test::More tests => 4;
	10
	11	my $tempdir = tempdir(CLEANUP => 1);
	12
	13	write_file("$tempdir/files", "$Bin/sample.yml");
	14
	15	my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-installer "
	16	. "-o $tempdir/Koha.pot -f $tempdir/files";
	17
	18	system($xgettext_cmd);
	19	my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");
	20
	21	my @expected = (
	22	{ msgid => '"Sample installer file"' },
	23	{ msgid => '"bar"' },
	24	{ msgid => '"baz"' },
	25	{ msgid => '"foo ツ"' },
	26	);
	27
	28	for (my $i = 0; $i < @expected; $i++) {
	29	my $expected = $expected[$i]->{msgid};
	30	my $expected_str = defined $expected ? $expected : 'not defined';
	31	is($pot->[$i + 1]->msgid, $expected, "$i: msgid is $expected_str");
	32	}

Line 0 Link Here

(-)a/t/misc/translator/xgettext-pref.t (+61 lines)
	1	#!/usr/bin/perl
	2
	3	use Modern::Perl;
	4
	5	use File::Slurp;
	6	use File::Temp qw(tempdir);
	7	use FindBin qw($Bin);
	8	use Locale::PO;
	9	use Test::More tests => 16;
	10
	11	my $tempdir = tempdir(CLEANUP => 1);
	12
	13	write_file("$tempdir/files", "$Bin/sample.pref");
	14
	15	my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-pref "
	16	. "-o $tempdir/Koha.pot -f $tempdir/files";
	17
	18	system($xgettext_cmd);
	19	my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");
	20
	21	my @expected = (
	22	{
	23	msgid => '"Section"',
	24	},
	25	{
	26	msgctxt => '"Section > Subsection > MultiplePref"',
	27	msgid => '"Bar"',
	28	},
	29	{
	30	msgctxt => '"Section > Subsection > MultiplePref"',
	31	msgid => '"Baz"',
	32	},
	33	{
	34	msgctxt => '"Section > Subsection > MultiplePref"',
	35	msgid => '"Foo ツ"',
	36	},
	37	{
	38	msgctxt => '"Section > Subsection > SamplePref"',
	39	msgid => '"Do"',
	40	},
	41	{
	42	msgctxt => '"Section > Subsection > SamplePref"',
	43	msgid => '"Do not do"',
	44	},
	45	{
	46	msgctxt => '"Section > Subsection > SamplePref"',
	47	msgid => '"that thing"',
	48	},
	49	{
	50	msgctxt => '"Section"',
	51	msgid => '"Subsection"',
	52	},
	53	);
	54
	55	for (my $i = 0; $i < @expected; $i++) {
	56	for my $key (qw(msgid msgctxt)) {
	57	my $expected = $expected[$i]->{$key};
	58	my $expected_str = defined $expected ? $expected : 'not defined';
	59	is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
	60	}
	61	}

Line 0 Link Here

(-)a/t/misc/translator/xgettext-tt2.t (+74 lines)
		1	#!/usr/bin/perl
		2
		3	use Modern::Perl;
		4
		5	use File::Slurp;
		6	use File::Temp qw(tempdir);
		7	use FindBin qw($Bin);
		8	use Locale::PO;
		9	use Test::More tests => 36;
		10
		11	my $tempdir = tempdir(CLEANUP => 1);
		12
		13	write_file("$tempdir/files", "$Bin/sample.tt");
		14
		15	my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-tt2 --from-code=UTF-8 "
		16	. "-o $tempdir/Koha.pot -f $tempdir/files";
		17
		18	system($xgettext_cmd);
		19	my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");
		20
		21	my @expected = (
		22	{
		23	msgid => '"hello ツ"',
		24	},
		25	{
		26	msgid => '"hello {name}"',
		27	},
		28	{
		29	msgid => '"item"',
		30	msgid_plural => '"items"',
		31	},
		32	{
		33	msgid => '"{count} item"',
		34	msgid_plural => '"{count} items"',
		35	},
		36	{
		37	msgid => '"hello"',
		38	msgctxt => '"context"',
		39	},
		40	{
		41	msgid => '"hello {name}"',
		42	msgctxt => '"context"',
		43	},
		44	{
		45	msgid => '"item"',
		46	msgid_plural => '"items"',
		47	msgctxt => '"context"',
		48	},
		49	{
		50	msgid => '"{count} item"',
		51	msgid_plural => '"{count} items"',
		52	msgctxt => '"context"',
		53	},
		54	{
		55	msgid => '"status is {status}"',
		56	},
		57	{
		58	msgid => '"active"',
		59	},
		60	{
		61	msgid => '"inactive"',
		62	},
		63	{
		64	msgid => '"Inside block"',
65	},
66	);
67
68	for (my $i = 0; $i < @expected; $i++) {
69	for my $key (qw(msgid msgid_plural msgctxt)) {
70	my $expected = $expected[$i]->{$key};
71	my $expected_str = defined $expected ? $expected : 'not defined';
72	is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
73	}
74	}