Attachment #109272 for bug #25067

View | Details | Raw Unified | Return to bug 25067
Collapse All | Expand All




# Internationalization

This page documents how internationalization works in Koha.

## Making strings translatable

There are several ways of making a string translatable, depending on where it
is located

### In Template::Toolkit files (`*.tt`)

The simplest way to make a string translatable in a template is to do nothing.
Templates are parsed as HTML files and almost all text nodes are considered as
translatable strings. This also includes some attributes like `title` and
`placeholder`.

This method has some downsides: you don't have full control over what would
appear in PO files and you cannot use plural forms or context. In order to do
that you have to use `i18n.inc`

`i18n.inc` contains several macros that, when used, make a string translatable.
The first thing to do is to make these macros available by adding

    [% PROCESS 'i18n.inc' %]

at the top of the template file. Then you can use those macros.

The simplest one is `t(msgid)`

    [% t('This is a translatable string') %]

You can also use variable substitution with `tx(msgid, vars)`

    [% tx('Hello, {name}', { name = 'World' }) %]

You can use plural forms with `tn(msgid, msgid_plural, count)`

    [% tn('a child', 'several children', number_of_children) %]

You can add context, to help translators when a term is ambiguous, with
`tp(msgctxt, msgid)`

    [% tp('verb', 'order') %]
    [% tp('noun', 'order') %]

Or any combinations of the above

    [% tnpx('bibliographic record', '{count} item', '{count} items', items_count, { count = items_count }) %]

### In JavaScript files (`*.js`)

Like in templates, you have several functions available. Just replace `t` by `__`.

    __('This is a translatable string');
    __npx('bibliographic record, '{count} item', '{count} items', items_count, { count: items_count });

### In Perl files (`*.pl`, `*.pm`)

You will have to add

    use Koha::I18N;

at the top of the file, and then the same functions as above will be available.

    __('This is a translatable string');
    __npx('bibliographic record, '{count} item', '{count} items', $items_count, count => $items_count);

### In installer and preferences YAML files (`*.yml`)

Nothing special to do here. All strings will be automatically translatable.

## Manipulating PO files

Once strings have been made translatable in source files, they have to be
extracted into PO files and uploaded on https://translate.koha-community.org/
so they can be translated.

### Install gulp first

The next sections rely on gulp. If it's not installed, run the following
commands:

    # as root
    npm install gulp-cli -g

    # as normal user, from the root of Koha repository
    yarn

### Create PO files for a new language

If you want to add translations for a new language, you have to create the
missing PO files. You can do that by executing the following command:

    # Replace xx-XX by your language tag
    gulp po:create --lang xx-XX

New PO files will be available in `misc/translator/po`.

### Update PO files with new strings

When new features or bugfixes are added to Koha, new translatable strings can
be added, other can be removed or modified, and the PO file become out of sync.

To be able to translate the new or modified strings, you have to update PO
files. This can be done by executing the following command:

    # Update PO files for all languages
    gulp po:update

    # or only one language
    gulp po:update --lang xx-XX

### Only extract strings

Creating or updating PO files automatically extract strings, but if for some
reasons you want to only extract strings without touching PO files, you can run
the following command:

    gulp po:extract

POT files will be available in `misc/translator`.

Lines 1-12 Link Here

(-)a/gulpfile.js (-1 / +292 lines)
1	/* eslint-env node */	1	/* eslint-env node */
2	/* eslint no-console:"off" */	2	/* eslint no-console:"off" */
3		3
4	const { dest, series, src, watch } = require('gulp');	4	const { dest, parallel, series, src, watch } = require('gulp');
		5
		6	const child_process = require('child_process');
		7	const fs = require('fs');
		8	const os = require('os');
		9	const path = require('path');
		10	const util = require('util');
5		11
6	const sass = require("gulp-sass");	12	const sass = require("gulp-sass");
7	const cssnano = require("gulp-cssnano");	13	const cssnano = require("gulp-cssnano");
8	const sourcemaps = require('gulp-sourcemaps');	14	const sourcemaps = require('gulp-sourcemaps');
9	const autoprefixer = require('gulp-autoprefixer');	15	const autoprefixer = require('gulp-autoprefixer');
		16	const concatPo = require('gulp-concat-po');
		17	const exec = require('gulp-exec');
		18	const merge = require('merge-stream');
		19	const through2 = require('through2');
		20	const Vinyl = require('vinyl');
10	const args = require('minimist')(process.argv.slice(2));	21	const args = require('minimist')(process.argv.slice(2));
11		22
12	const STAFF_JS_BASE = "koha-tmpl/intranet-tmpl/prog/js";	23	const STAFF_JS_BASE = "koha-tmpl/intranet-tmpl/prog/js";
Lines 46-53 function build() { Link Here
46	.pipe(dest(css_base));	57	.pipe(dest(css_base));
47	}	58	}
48		59
		60	const poTasks = {
		61	'marc-MARC21': {
		62	extract: po_extract_marc_marc21,
		63	create: po_create_marc_marc21,
		64	update: po_update_marc_marc21,
		65	},
		66	'marc-NORMARC': {
		67	extract: po_extract_marc_normarc,
		68	create: po_create_marc_normarc,
		69	update: po_update_marc_normarc,
		70	},
		71	'marc-UNIMARC': {
		72	extract: po_extract_marc_unimarc,
		73	create: po_create_marc_unimarc,
		74	update: po_update_marc_unimarc,
		75	},
		76	'staff-prog': {
		77	extract: po_extract_staff,
		78	create: po_create_staff,
		79	update: po_update_staff,
		80	},
		81	'opac-bootstrap': {
		82	extract: po_extract_opac,
		83	create: po_create_opac,
		84	update: po_update_opac,
		85	},
		86	'pref': {
		87	extract: po_extract_pref,
		88	create: po_create_pref,
		89	update: po_update_pref,
		90	},
		91	'messages': {
		92	extract: po_extract_messages,
		93	create: po_create_messages,
		94	update: po_update_messages,
		95	},
		96	'messages-js': {
		97	extract: po_extract_messages_js,
		98	create: po_create_messages_js,
		99	update: po_update_messages_js,
		100	},
		101	'installer': {
		102	extract: po_extract_installer,
		103	create: po_create_installer,
		104	update: po_update_installer,
		105	},
		106	'installer-MARC21': {
		107	extract: po_extract_installer_marc21,
		108	create: po_create_installer_marc21,
		109	update: po_update_installer_marc21,
		110	},
		111	};
		112
		113	const poTypes = Object.keys(poTasks);
		114
		115	function po_extract_marc (type) {
		116	return src(`koha-tmpl/-tmpl//en/*/${type}*`, { read: false, nocase: true })
		117	.pipe(xgettext('misc/translator/xgettext.pl --charset=UTF-8 -s', `Koha-marc-${type}.pot`))
		118	.pipe(dest('misc/translator'))
		119	}
		120
		121	function po_extract_marc_marc21 () { return po_extract_marc('MARC21') }
		122	function po_extract_marc_normarc () { return po_extract_marc('NORMARC') }
		123	function po_extract_marc_unimarc () { return po_extract_marc('UNIMARC') }
124
125	function po_extract_staff () {
126	const globs = [
127	'koha-tmpl/intranet-tmpl/prog/en/*/.tt',
128	'koha-tmpl/intranet-tmpl/prog/en/*/.inc',
129	'!koha-tmpl/intranet-tmpl/prog/en/*/MARC21*',
130	'!koha-tmpl/intranet-tmpl/prog/en/*/NORMARC*',
131	'!koha-tmpl/intranet-tmpl/prog/en/*/UNIMARC*',
132	];
133
134	return src(globs, { read: false, nocase: true })
135	.pipe(xgettext('misc/translator/xgettext.pl --charset=UTF-8 -s', 'Koha-staff-prog.pot'))
136	.pipe(dest('misc/translator'))
137	}
138
139	function po_extract_opac () {
140	const globs = [
141	'koha-tmpl/opac-tmpl/bootstrap/en/*/.tt',
142	'koha-tmpl/opac-tmpl/bootstrap/en/*/.inc',
143	'!koha-tmpl/opac-tmpl/bootstrap/en/*/MARC21*',
144	'!koha-tmpl/opac-tmpl/bootstrap/en/*/NORMARC*',
145	'!koha-tmpl/opac-tmpl/bootstrap/en/*/UNIMARC*',
146	];
147
148	return src(globs, { read: false, nocase: true })
149	.pipe(xgettext('misc/translator/xgettext.pl --charset=UTF-8 -s', 'Koha-opac-bootstrap.pot'))
150	.pipe(dest('misc/translator'))
151	}
152
153	const xgettext_options = '--from-code=UTF-8 --package-name Koha '
154	+ '--package-version= -k -k__ -k__x -k__n:1,2 -k__nx:1,2 -k__xn:1,2 '
155	+ '-k__p:1c,2 -k__px:1c,2 -k__np:1c,2,3 -k__npx:1c,2,3 -kN__ '
156	+ '-kN__n:1,2 -kN__p:1c,2 -kN__np:1c,2,3 --force-po';
157
158	function po_extract_messages_js () {
159	const globs = [
160	'koha-tmpl/intranet-tmpl/prog/js/*/.js',
161	'koha-tmpl/opac-tmpl/bootstrap/js/*/.js',
162	];
163
164	return src(globs, { read: false, nocase: true })
165	.pipe(xgettext(`xgettext -L JavaScript ${xgettext_options}`, 'Koha-messages-js.pot'))
166	.pipe(dest('misc/translator'))
167	}
168
169	function po_extract_messages () {
170	const perlStream = src(['*/.pl', '*/.pm'], { read: false, nocase: true })
171	.pipe(xgettext(`xgettext -L Perl ${xgettext_options}`, 'Koha-perl.pot'))
172
173	const ttStream = src([
174	'koha-tmpl/intranet-tmpl/prog/en/*/.tt',
175	'koha-tmpl/intranet-tmpl/prog/en/*/.inc',
176	'koha-tmpl/opac-tmpl/bootstrap/en/*/.tt',
177	'koha-tmpl/opac-tmpl/bootstrap/en/*/.inc',
178	], { read: false, nocase: true })
179	.pipe(xgettext('misc/translator/xgettext-tt2 --from-code=UTF-8', 'Koha-tt.pot'))
180
181	const headers = {
182	'Project-Id-Version': 'Koha',
183	'Content-Type': 'text/plain; charset=UTF-8',
184	};
185
186	return merge(perlStream, ttStream)
187	.pipe(concatPo('Koha-messages.pot', { headers }))
188	.pipe(dest('misc/translator'))
189	}
190
191	function po_extract_pref () {
192	return src('koha-tmpl/intranet-tmpl/prog/en/modules/admin/preferences/*.pref', { read: false })
193	.pipe(xgettext('misc/translator/xgettext-pref', 'Koha-pref.pot'))
194	.pipe(dest('misc/translator'))
195	}
196
197	function po_extract_installer () {
198	const globs = [
199	'installer/data/mysql/en/mandatory/*.yml',
200	'installer/data/mysql/en/optional/*.yml',
201	];
202
203	return src(globs, { read: false, nocase: true })
204	.pipe(xgettext('misc/translator/xgettext-installer', 'Koha-installer.pot'))
205	.pipe(dest('misc/translator'))
206	}
207
208	function po_extract_installer_marc (type) {
209	const globs = `installer/data/mysql/en/marcflavour/${type}/*/.yml`;
210
211	return src(globs, { read: false, nocase: true })
212	.pipe(xgettext('misc/translator/xgettext-installer', `Koha-installer-${type}.pot`))
213	.pipe(dest('misc/translator'))
214	}
215
216	function po_extract_installer_marc21 () { return po_extract_installer_marc('MARC21') }
217
218	function po_create_type (type) {
219	const access = util.promisify(fs.access);
220	const exec = util.promisify(child_process.exec);
221
222	const languages = getLanguages();
223	const promises = [];
224	for (const language of languages) {
225	const locale = language.split('-').filter(s => s.length !== 4).join('_');
226	const po = `misc/translator/po/${language}-${type}.po`;
227	const pot = `misc/translator/Koha-${type}.pot`;
228
229	const promise = access(po)
230	.catch(() => exec(`msginit -o ${po} -i ${pot} -l ${locale} --no-translator`))
231	promises.push(promise);
232	}
233
234	return Promise.all(promises);
235	}
236
237	function po_create_marc_marc21 () { return po_create_type('marc-MARC21') }
238	function po_create_marc_normarc () { return po_create_type('marc-NORMARC') }
239	function po_create_marc_unimarc () { return po_create_type('marc-UNIMARC') }
240	function po_create_staff () { return po_create_type('staff-prog') }
241	function po_create_opac () { return po_create_type('opac-bootstrap') }
242	function po_create_pref () { return po_create_type('pref') }
243	function po_create_messages () { return po_create_type('messages') }
244	function po_create_messages_js () { return po_create_type('messages-js') }
245	function po_create_installer () { return po_create_type('installer') }
246	function po_create_installer_marc21 () { return po_create_type('installer-MARC21') }
247
248	function po_update_type (type) {
249	const msgmerge_opts = '--backup=off --quiet --sort-output --update';
250	const cmd = `msgmerge ${msgmerge_opts} <%= file.path %> misc/translator/Koha-${type}.pot`;
251	const languages = getLanguages();
252	const globs = languages.map(language => `misc/translator/po/${language}-${type}.po`);
253
254	return src(globs)
255	.pipe(exec(cmd, { continueOnError: true }))
256	.pipe(exec.reporter({ err: false, stdout: false }))
257	}
258
259	function po_update_marc_marc21 () { return po_update_type('marc-MARC21') }
260	function po_update_marc_normarc () { return po_update_type('marc-NORMARC') }
261	function po_update_marc_unimarc () { return po_update_type('marc-UNIMARC') }
262	function po_update_staff () { return po_update_type('staff-prog') }
263	function po_update_opac () { return po_update_type('opac-bootstrap') }
264	function po_update_pref () { return po_update_type('pref') }
265	function po_update_messages () { return po_update_type('messages') }
266	function po_update_messages_js () { return po_update_type('messages-js') }
267	function po_update_installer () { return po_update_type('installer') }
268	function po_update_installer_marc21 () { return po_update_type('installer-MARC21') }
269
270	/**
271	* Gulp plugin that executes xgettext-like command `cmd` on all files given as
272	* input, and then outputs the result as a POT file named `filename`.
273	* `cmd` should accept -o and -f options
274	*/
275	function xgettext (cmd, filename) {
276	const filenames = [];
277
278	function transform (file, encoding, callback) {
279	filenames.push(path.relative(file.cwd, file.path));
280	callback();
281	}
282
283	function flush (callback) {
284	fs.mkdtemp(path.join(os.tmpdir(), 'koha-'), (err, folder) => {
285	const outputFilename = path.join(folder, filename);
286	const filesFilename = path.join(folder, 'files');
287	fs.writeFile(filesFilename, filenames.join(os.EOL), err => {
288	if (err) return callback(err);
289
290	const command = `${cmd} -o ${outputFilename} -f ${filesFilename}`;
291	child_process.exec(command, err => {
292	if (err) return callback(err);
293
294	fs.readFile(outputFilename, (err, data) => {
295	if (err) return callback(err);
296
297	const file = new Vinyl();
298	file.path = path.join(file.base, filename);
299	file.contents = data;
300	callback(null, file);
301	});
302	});
303	});
304	})
305	}
306
307	return through2.obj(transform, flush);
308	}
309
310	/**
311	* Return languages selected for PO-related tasks
312	*
313	* This can be either languages given on command-line with --lang option, or
314	* all the languages found in misc/translator/po otherwise
315	*/
316	function getLanguages () {
317	if (Array.isArray(args.lang)) {
318	return args.lang;
319	}
320
321	if (args.lang) {
322	return [args.lang];
323	}
324
325	const filenames = fs.readdirSync('misc/translator/po')
326	.filter(filename => filename.endsWith('.po'))
327	.filter(filename => !filename.startsWith('.'))
328
329	const re = new RegExp('-(' + poTypes.join('\|') + ')\.po$');
330	languages = filenames.map(filename => filename.replace(re, ''))
331
332	return Array.from(new Set(languages));
333	}
334
49	exports.build = build;	335	exports.build = build;
50	exports.css = css;	336	exports.css = css;
		337
		338	exports['po:create'] = parallel(...poTypes.map(type => series(poTasks[type].extract, poTasks[type].create)));
		339	exports['po:update'] = parallel(...poTypes.map(type => series(poTasks[type].extract, poTasks[type].update)));
		340	exports['po:extract'] = parallel(...poTypes.map(type => poTasks[type].extract));
		341
51	exports.default = function () {	342	exports.default = function () {
52	watch(css_base + "/src/*/.scss", series('css'));	343	watch(css_base + "/src/*/.scss", series('css'));
53	}	344	}




use C4::Context;
# WARNING: Any other tested YAML library fails to work properly in this
# script content
use YAML::Syck qw( LoadFile DumpFile );
use Locale::PO;
use FindBin qw( $Bin );
use File::Basename;
use File::Find;
use File::Path qw( make_path );
use File::Copy;
use File::Slurp;
use File::Spec;
use File::Temp qw( tempdir tempfile );
use Template::Parser;
use PPI;


$YAML::Syck::ImplicitTyping = 1;


# Default file header for .po syspref files
my $default_pref_po_header = Locale::PO->new(-msgid => '', -msgstr =>
    "Project-Id-Version: PACKAGE VERSION\\n" .
    "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\n" .
    "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\\n" .
    "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\\n" .
    "MIME-Version: 1.0\\n" .
    "Content-Type: text/plain; charset=UTF-8\\n" .
    "Content-Transfer-Encoding: 8bit\\n" .
    "Plural-Forms: nplurals=2; plural=(n > 1);\\n"
);


sub set_lang {
    my ($self, $lang) = @_;


                            "/prog/$lang/modules/admin/preferences";
}


sub new {
    my ($class, $lang, $pref_only, $verbose) = @_;


    $self->{verbose}         = $verbose;
    $self->{process}         = "$Bin/tmpl_process3.pl " . ($verbose ? '' : '-q');
    $self->{path_po}         = "$Bin/po";
    $self->{po}              = {};
    $self->{domain}          = 'Koha';
    $self->{cp}              = `which cp`;
    $self->{msgmerge}        = `which msgmerge`;
    $self->{msgfmt}          = `which msgfmt`;
    $self->{msginit}         = `which msginit`;
    $self->{msgattrib}       = `which msgattrib`;
    $self->{xgettext}        = `which xgettext`;
    $self->{sed}             = `which sed`;
    $self->{po2json}         = "$Bin/po2json";
    $self->{gzip}            = `which gzip`;
    $self->{gunzip}          = `which gunzip`;
    chomp $self->{cp};
    chomp $self->{msgmerge};
    chomp $self->{msgfmt};
    chomp $self->{msginit};
    chomp $self->{msgattrib};
    chomp $self->{xgettext};
    chomp $self->{sed};
    chomp $self->{gzip};
    chomp $self->{gunzip};

    unless ($self->{xgettext}) {
        die "Missing 'xgettext' executable. Have you installed the gettext package?\n";
    }

    # Get all .pref file names
    opendir my $fh, $self->{path_pref_en};
    my @pref_files = grep { /\.pref$/ } readdir($fh);

    bless $self, $class;
}


sub po_filename {
    my $self   = shift;
    my $suffix = shift;

    return $trans_file;
}

sub get_trans_text {
    my ($self, $msgctxt, $msgid) = @_;

    my $key = ($msgctxt // '') . ";$msgid";
    my ($self, $id, $comment) = @_;
    my $po = $self->{po};
    my $p = $po->{$id};
    if ( $p ) {
        $p->comment( $p->comment . "\n" . $comment );
    }
    else {
        $po->{$id} = Locale::PO->new(
            -comment => $comment,
            -msgid   => $id,
            -msgstr  => ''
        );
    }
}


    my $po = $self->{po}->{$key};
    if ($po) {
        my $msgstr = Locale::PO->dequote($po->msgstr);

        return $msgstr || $msgid;
        my $pref_name = '';
        for my $element ( @$pref ) {
            if ( ref( $element) eq 'HASH' ) {
                $pref_name = $element->{pref};
                last;
            }
        }
        for my $element ( @$pref ) {
            if ( ref( $element) eq 'HASH' ) {
                while ( my ($key, $value) = each(%$element) ) {
                    next unless $key eq 'choices' or $key eq 'multiple';
                    next unless ref($value) eq 'HASH';
                    for my $ckey ( keys %$value ) {
                        my $id = $self->{file} . "#$pref_name# " . $value->{$ckey};
                        $self->po_append( $id, $comment );
                    }
                }
            }
            elsif ( $element ) {
                $self->po_append( $self->{file} . "#$pref_name# $element", $comment );
            }
        }
    }
}

    return $msgid;
sub get_trans_text {
    my ($self, $id) = @_;

    my $po = $self->{po}->{$id};
    return unless $po;
    return Locale::PO->dequote($po->msgstr);
}

sub get_translated_tab_content {
    my ($self, $tab, $tab_content) = @_;

    if ( ref($tab_content) eq 'ARRAY' ) {
        return $self->get_translated_prefs($tab, $tab_content);

    for my $p ( @$prefs ) {
        my $pref_name = '';
        next unless $p;
        for my $element ( @$p ) {
            if ( ref( $element) eq 'HASH' ) {
                $pref_name = $element->{pref};
                last;
            }
        }
        for my $i ( 0..@$p-1 ) {
            my $element = $p->[$i];
            if ( ref( $element) eq 'HASH' ) {
                while ( my ($key, $value) = each(%$element) ) {
                    next unless $key eq 'choices' or $key eq 'multiple';
                    next unless ref($value) eq 'HASH';
                    for my $ckey ( keys %$value ) {
                        my $id = $self->{file} . "#$pref_name# " . $value->{$ckey};
                        my $text = $self->get_trans_text( $id );
                        $value->{$ckey} = $text if $text;
                    }
                }
            }
            elsif ( $element ) {
                my $id = $self->{file} . "#$pref_name# $element";
                my $text = $self->get_trans_text( $id );
                $p->[$i] = $text if $text;
            }
        }
    }
}

    my $translated_tab_content = {
        map {
            my $section = $_;
            my $sysprefs = $tab_content->{$section};
            my $context = "$tab > $section";

            $self->get_trans_text($tab, $section) => $self->get_translated_prefs($context, $sysprefs);
        } keys %$tab_content
    };

    return $translated_tab_content;
        my $pref = LoadFile( $self->{path_pref_en} . "/$file" );
        $self->{file} = $file;
        # Entries for tab titles
        $self->po_append( $self->{file}, $_ ) for keys %$pref;
        while ( my ($tab, $tab_content) = each %$pref ) {
            if ( ref($tab_content) eq 'ARRAY' ) {
                $self->add_prefs( $tab, $tab_content );
                next;
            }
            while ( my ($section, $sysprefs) = each %$tab_content ) {
                my $comment = "$tab > $section";
                $self->po_append( $self->{file} . " " . $section, $comment );
                $self->add_prefs( $comment, $sysprefs );
            }
        }
    }
}

sub get_translated_prefs {
    my ($self, $context, $sysprefs) = @_;

    my $translated_prefs = [
        map {
            my ($pref_elt) = grep { ref($_) eq 'HASH' && exists $_->{pref} } @$_;
            my $pref_name = $pref_elt ? $pref_elt->{pref} : '';

            my $translated_syspref = [
                map {
                    $self->get_translated_pref("$context > $pref_name", $_ );
                } @$_
            ];

            $translated_syspref;
        } @$sysprefs
    ];
}

    return $translated_prefs;
}

sub get_translated_pref {
    my ($self, $context, $syspref) = @_;

    unless (ref($syspref)) {
        return $self->get_trans_text($context, $syspref // '');
    }

    my $translated_pref = {
        map {
            my $key = $_;
            my $value = $syspref->{$key};

            my $translated_value = $value;
            if (($key eq 'choices' || $key eq 'multiple') && ref($value) eq 'HASH') {
                $translated_value = {
                    map {
                        $_ => $self->get_trans_text($context, $value->{$_})
                    } keys %$value
                }
            }

            $key => $translated_value
        } keys %$syspref
    };

    return $translated_pref;
    my $self = shift;
    print "Update '", $self->{lang},
          "' preferences .po file from 'en' .pref files\n" if $self->{verbose};
    $self->get_po_merged_with_en();
    $self->save_po();
}


sub install_prefs {
    my $self = shift;


        exit;
    }

    my @po_entries = @{ Locale::PO->load_file_asarray($self->po_filename("-pref.po"), 'utf8') };
    $self->{po} = { map {
        my $msgctxt = $_->msgctxt ? Locale::PO->dequote($_->msgctxt) : '';
        my $msgid = Locale::PO->dequote($_->msgid);

        "$msgctxt;$msgid" => $_;
    } @po_entries };

    for my $file ( @{$self->{pref_files}} ) {
        my $pref = LoadFile( $self->{path_pref_en} . "/$file" );

        my $translated_pref = {
            map {
                my $tab = $_;
                my $tab_content = $pref->{$tab};

                $self->get_trans_text(undef, $tab) => $self->get_translated_tab_content($tab, $tab_content);
            } keys %$pref
        };


                $self->update_tab_prefs( $pref, $tab_content );
                next;
            }
            while ( my ($section, $sysprefs) = each %$tab_content ) {
                $self->update_tab_prefs( $pref, $sysprefs );
            }
            my $ntab = {};
            for my $section ( keys %$tab_content ) {
                my $id = $self->{file} . " $section";
                my $text = $self->get_trans_text($id);
                my $nsection = $text ? $text : $section;
                if( exists $ntab->{$nsection} ) {
                    # When translations collide (see BZ 18634)
                    push @{$ntab->{$nsection}}, @{$tab_content->{$section}};
                } else {
                    $ntab->{$nsection} = $tab_content->{$section};
                }
            }
            $pref->{$tab} = $ntab;
        }
        my $file_trans = $self->{po_path_lang} . "/$file";
        print "Write $file\n" if $self->{verbose};
        DumpFile($file_trans, $translated_pref);
        print $fh Dump($pref);
    }
}


    }
}


sub update_tmpl {
    my ($self, $files) = @_;

    say "Update templates" if $self->{verbose};
    for my $trans ( @{$self->{interface}} ) {
        my @files   = @$files;
        my @nomarc = ();
        print
            "  Update templates '$trans->{name}'\n",
            "    From: $trans->{dir}/en/\n",
            "    To  : $self->{path_po}/$self->{lang}$trans->{suffix}\n"
                if $self->{verbose};

        my $trans_dir = join("/en/ -i ",split(" ",$trans->{dir}))."/en/"; # multiple source dirs
        # if processing MARC po file, only use corresponding files
        my $marc      = ( $trans->{name} =~ /MARC/ )?"-m \"$trans->{name}\"":"";            # for MARC translations
        # if not processing MARC po file, ignore all MARC files
        @nomarc       = ( 'marc21', 'unimarc', 'normarc' ) if ( $trans->{name} !~ /MARC/ );      # hardcoded MARC variants

        system
            "$self->{process} update " .
            "-i $trans_dir " .
            "-s $self->{path_po}/$self->{lang}$trans->{suffix} -r " .
            "$marc "     .
            ( @files   ? ' -f ' . join ' -f ', @files : '') .
            ( @nomarc  ? ' -n ' . join ' -n ', @nomarc : '');
    }
}


sub create_prefs {
    my $self = shift;

    if ( -e $self->po_filename("-pref.po") ) {
        say "Preferences .po file already exists. Delete it if you want to recreate it.";
        return;
    }
    $self->get_po_from_prefs();
    $self->save_po();
}

sub get_po_from_target {
    my $self   = shift;
    my $target = shift;

    my $po;
    my $po_head = new Locale::PO;
    $po_head->{msgid}  = "\"\"";
    $po_head->{msgstr} = "".
        "Project-Id-Version: Koha Project - Installation files\\n" .
        "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\n" .
        "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\\n" .
        "Language-Team: Koha Translation Team\\n" .
        "Language: ".$self->{lang}."\\n" .
        "MIME-Version: 1.0\\n" .
        "Content-Type: text/plain; charset=UTF-8\\n" .
        "Content-Transfer-Encoding: 8bit\\n";

    my @dirs = @{ $target->{dirs} };
    my $intradir = $self->{context}->config('intranetdir');
    for my $dir ( @dirs ) {                                                     # each dir
        opendir( my $dh, "$intradir/$dir" ) or die ("Can't open $intradir/$dir");
        my @filelist = grep { $_ =~ m/\.yml/ } readdir($dh);                    # Just yaml files
        close($dh);
        for my $file ( @filelist ) {                                            # each file
            my $yaml   = LoadFile( "$intradir/$dir/$file" );
            my @tables = @{ $yaml->{'tables'} };
            my $tablec;
            for my $table ( @tables ) {                                         # each table
                $tablec++;
                my $table_name = ( keys %$table )[0];
                my @translatable = @{ $table->{$table_name}->{translatable} };
                my @rows = @{ $table->{$table_name}->{rows} };
                my @multiline = @{ $table->{$table_name}->{'multiline'} };      # to check multiline values
                my $rowc;
                for my $row ( @rows ) {                                         # each row
                    $rowc++;
                    for my $field ( @translatable ) {                           # each field
                        if ( @multiline and grep { $_ eq $field } @multiline ) {    # multiline fields, only notices ATM
                            my $mulc;
                            foreach my $line ( @{$row->{$field}} ) {
                                $mulc++;
                                next if ( $line =~ /^(\s*<.*?>\s*$|^\s*\[.*?\]\s*|\s*)$/ );                     # discard pure html, TT, empty
                                $line =~ s/(<<.*?>>|\[\%.*?\%\]|<.*?>)/\%s/g;                                   # put placeholders
                                next if ( $line =~ /^(\s|%s|-|[[:punct:]]|\(|\))*$/ or length($line) < 2 );     # discard non strings
                                if ( not $po->{ $line } ) {
                                    my $msg = new Locale::PO(
                                                -msgid => $line, -msgstr => '',
                                                -reference => "$dir/$file:$table_name:$tablec:row:$rowc:mul:$mulc" );
                                    $po->{ $line } = $msg;
                                }
                            }
                        } else {
                            if ( defined $row->{$field} and length($row->{$field}) > 1                         # discard null values and small strings
                                 and not $po->{ $row->{$field} } ) {
                                my $msg = new Locale::PO(
                                            -msgid => $row->{$field}, -msgstr => '',
                                            -reference => "$dir/$file:$table_name:$tablec:row:$rowc" );
                                $po->{ $row->{$field} } = $msg;
                            }
                        }
                    }
                }
            }
            my $desccount;
            for my $description ( @{ $yaml->{'description'} } ) {
                $desccount++;
                if ( length($description) > 1 and not $po->{ $description } ) {
                    my $msg = new Locale::PO(
                                -msgid => $description, -msgstr => '',
                                -reference => "$dir/$file:description:$desccount" );
                    $po->{ $description } = $msg;
                }
            }
        }
    }
    $po->{''} = $po_head if ( $po );

    return $po;
}

sub create_installer {
    my $self = shift;
    return unless ( $self->{installer} );

    say "Create installer translation files\n" if $self->{verbose};

    my @targets = @{ $self->{installer} };             # each installer target (common,marc21,unimarc)

    for my $target ( @targets ) {
        if ( -e $self->po_filename( $target->{suffix} ) ) {
            say "$self->{lang}$target->{suffix} file already exists. Delete it if you want to recreate it.";
            return;
        }
    }

    for my $target ( @targets ) {
        my $po = get_po_from_target( $self, $target );
        # create output file only if there is something to write
        if ( $po ) {
            my $po_file = $self->po_filename( $target->{suffix} );
            Locale::PO->save_file_fromhash( $po_file, $po );
            say "Saved in file: ", $po_file if $self->{verbose};
        }
    }
}

sub update_installer {
    my $self = shift;
    return unless ( $self->{installer} );

    say "Update installer translation files\n" if $self->{verbose};

    my @targets = @{ $self->{installer} };             # each installer target (common,marc21,unimarc)

    for my $target ( @targets ) {
        return unless ( -e $self->po_filename( $target->{suffix} ) );
        my $po = get_po_from_target( $self, $target );
        # update file only if there is something to update
        if ( $po ) {
            my ( $fh, $po_temp ) = tempfile();
            binmode( $fh, ":encoding(UTF-8)" );
            Locale::PO->save_file_fromhash( $po_temp, $po );
            my $po_file = $self->po_filename( $target->{suffix} );
            eval {
                my $st = system($self->{msgmerge}." ".($self->{verbose}?'':'-q').
                         " -s $po_file $po_temp -o - | ".$self->{msgattrib}." --no-obsolete -o $po_file");
            };
            say "Updated file: ", $po_file if $self->{verbose};
        }
    }
}

sub translate_yaml {
    my $self   = shift;
    my $target = shift;

    }
}

sub create_tmpl {
    my ($self, $files) = @_;

    say "Create templates\n" if $self->{verbose};
    for my $trans ( @{$self->{interface}} ) {
        my @files   = @$files;
        my @nomarc = ();
        print
            "  Create templates .po files for '$trans->{name}'\n",
            "    From: $trans->{dir}/en/\n",
            "    To  : $self->{path_po}/$self->{lang}$trans->{suffix}\n"
                if $self->{verbose};

        my $trans_dir = join("/en/ -i ",split(" ",$trans->{dir}))."/en/"; # multiple source dirs
        # if processing MARC po file, only use corresponding files
        my $marc      = ( $trans->{name} =~ /MARC/ )?"-m \"$trans->{name}\"":"";            # for MARC translations
        # if not processing MARC po file, ignore all MARC files
        @nomarc       = ( 'marc21', 'unimarc', 'normarc' ) if ( $trans->{name} !~ /MARC/ ); # hardcoded MARC variants

        system
            "$self->{process} create " .
            "-i $trans_dir " .
            "-s $self->{path_po}/$self->{lang}$trans->{suffix} -r " .
            "$marc " .
            ( @files  ? ' -f ' . join ' -f ', @files   : '') .
            ( @nomarc ? ' -n ' . join ' -n ', @nomarc : '');
    }
}

sub locale_name {
    my $self = shift;


    return $locale;
}

sub create_messages {
    my $self = shift;

    my $pot = "$Bin/$self->{domain}.pot";
    my $po = "$self->{path_po}/$self->{lang}-messages.po";
    my $js_pot = "$self->{domain}-js.pot";
    my $js_po = "$self->{path_po}/$self->{lang}-messages-js.po";

    unless ( -f $pot && -f $js_pot ) {
        $self->extract_messages();
    }

    say "Create messages ($self->{lang})" if $self->{verbose};
    my $locale = $self->locale_name();
    system "$self->{msginit} -i $pot -o $po -l $locale --no-translator 2> /dev/null";
    warn "Problems creating $pot ".$? if ( $? == -1 );
    system "$self->{msginit} -i $js_pot -o $js_po -l $locale --no-translator 2> /dev/null";
    warn "Problems creating $js_pot ".$? if ( $? == -1 );

    # If msginit failed to correctly set Plural-Forms, set a default one
    system "$self->{sed} --in-place "
        . "--expression='s/Plural-Forms: nplurals=INTEGER; plural=EXPRESSION/Plural-Forms: nplurals=2; plural=(n != 1)/' "
        . "$po $js_po";
}

sub update_messages {
    my $self = shift;

    my $pot = "$Bin/$self->{domain}.pot";
    my $po = "$self->{path_po}/$self->{lang}-messages.po";
    my $js_pot = "$self->{domain}-js.pot";
    my $js_po = "$self->{path_po}/$self->{lang}-messages-js.po";

    unless ( -f $pot && -f $js_pot ) {
        $self->extract_messages();
    }

    if ( -f $po && -f $js_pot ) {
        say "Update messages ($self->{lang})" if $self->{verbose};
        system "$self->{msgmerge} --backup=off --quiet -U $po $pot";
        system "$self->{msgmerge} --backup=off --quiet -U $js_po $js_pot";
    } else {
        $self->create_messages();
    }
}

sub extract_messages_from_templates {
    my ($self, $tempdir, $type, @files) = @_;

    my $htdocs = $type eq 'intranet' ? 'intrahtdocs' : 'opachtdocs';
    my $dir = $self->{context}->config($htdocs);
    my @keywords = qw(t tx tn txn tnx tp tpx tnp tnpx);
    my $parser = Template::Parser->new();

    foreach my $file (@files) {
        say "Extract messages from $file" if $self->{verbose};
        my $template = read_file(File::Spec->catfile($dir, $file));

        # No need to process a file that doesn't use the i18n.inc file.
        next unless $template =~ /i18n\.inc/;

        my $data = $parser->parse($template);
        unless ($data) {
            warn "Error at $file : " . $parser->error();
            next;
        }

        my $destfile = $type eq 'intranet' ?
            File::Spec->catfile($tempdir, 'koha-tmpl', 'intranet-tmpl', $file) :
            File::Spec->catfile($tempdir, 'koha-tmpl', 'opac-tmpl', $file);

        make_path(dirname($destfile));
        open my $fh, '>', $destfile;

        my @blocks = ($data->{BLOCK}, values %{ $data->{DEFBLOCKS} });
        foreach my $block (@blocks) {
            my $document = PPI::Document->new(\$block);

            # [% t('foo') %] is compiled to
            # $output .= $stash->get(['t', ['foo']]);
            # We try to find all nodes corresponding to keyword (here 't')
            my $nodes = $document->find(sub {
                my ($topnode, $element) = @_;

                # Filter out non-valid keywords
                return 0 unless ($element->isa('PPI::Token::Quote::Single'));
                return 0 unless (grep {$element->content eq qq{'$_'}} @keywords);

                # keyword (e.g. 't') should be the first element of the arrayref
                # passed to $stash->get()
                return 0 if $element->sprevious_sibling;

                return 0 unless $element->snext_sibling
                    && $element->snext_sibling->snext_sibling
                    && $element->snext_sibling->snext_sibling->isa('PPI::Structure::Constructor');

                # Check that it's indeed a call to $stash->get()
                my $statement = $element->statement->parent->statement->parent->statement;
                return 0 unless grep { $_->isa('PPI::Token::Symbol') && $_->content eq '$stash' } $statement->children;
                return 0 unless grep { $_->isa('PPI::Token::Operator') && $_->content eq '->' } $statement->children;
                return 0 unless grep { $_->isa('PPI::Token::Word') && $_->content eq 'get' } $statement->children;

                return 1;
            });

            next unless $nodes;

            # Write the Perl equivalent of calls to t* functions family, so
            # xgettext can extract the strings correctly
            foreach my $node (@$nodes) {
                my @args = map {
                    $_->significant && !$_->isa('PPI::Token::Operator') ? $_->content : ()
                } $node->snext_sibling->snext_sibling->find_first('PPI::Statement')->children;

                my $keyword = $node->content;
                $keyword =~ s/^'t(.*)'$/__$1/;

                # Only keep required args to have a clean output
                my @required_args = shift @args;
                push @required_args, shift @args if $keyword =~ /n/;
                push @required_args, shift @args if $keyword =~ /p/;

                say $fh "$keyword(" . join(', ', @required_args) . ");";
            }

        }

        close $fh;
    }

    return $tempdir;
}

sub extract_messages {
    my $self = shift;

    say "Extract messages into POT file" if $self->{verbose};

    my $intranetdir = $self->{context}->config('intranetdir');
    my $opacdir = $self->{context}->config('opacdir');

    # Find common ancestor directory
    my @intranetdirs = File::Spec->splitdir($intranetdir);
    my @opacdirs = File::Spec->splitdir($opacdir);
    my @basedirs;
    while (@intranetdirs and @opacdirs) {
        my ($dir1, $dir2) = (shift @intranetdirs, shift @opacdirs);
        last if $dir1 ne $dir2;
        push @basedirs, $dir1;
    }
    my $basedir = File::Spec->catdir(@basedirs);

    my @files_to_scan;
    my @directories_to_scan = ('.');
    my @blacklist = map { File::Spec->catdir(@intranetdirs, $_) } qw(blib koha-tmpl skel tmp t);
    while (@directories_to_scan) {
        my $dir = shift @directories_to_scan;
        opendir DIR, File::Spec->catdir($basedir, $dir) or die "Unable to open $dir: $!";
        foreach my $entry (readdir DIR) {
            next if $entry =~ /^\./;
            my $relentry = File::Spec->catfile($dir, $entry);
            my $abspath = File::Spec->catfile($basedir, $relentry);
            if (-d $abspath and not grep { $_ eq $relentry } @blacklist) {
                push @directories_to_scan, $relentry;
            } elsif (-f $abspath and $relentry =~ /\.(pl|pm)$/) {
                push @files_to_scan, $relentry;
            }
        }
    }

    my $intrahtdocs = $self->{context}->config('intrahtdocs');
    my $opachtdocs = $self->{context}->config('opachtdocs');

    my @intranet_tt_files;
    find(sub {
        if ($File::Find::dir =~ m|/en/| && $_ =~ m/\.(tt|inc)$/) {
            my $filename = $File::Find::name;
            $filename =~ s|^$intrahtdocs/||;
            push @intranet_tt_files, $filename;
        }
    }, $intrahtdocs);

    my @opac_tt_files;
    find(sub {
        if ($File::Find::dir =~ m|/en/| && $_ =~ m/\.(tt|inc)$/) {
            my $filename = $File::Find::name;
            $filename =~ s|^$opachtdocs/||;
            push @opac_tt_files, $filename;
        }
    }, $opachtdocs);

    my $tempdir = tempdir('Koha-translate-XXXX', TMPDIR => 1, CLEANUP => 1);
    $self->extract_messages_from_templates($tempdir, 'intranet', @intranet_tt_files);
    $self->extract_messages_from_templates($tempdir, 'opac', @opac_tt_files);

    @intranet_tt_files = map { File::Spec->catfile('koha-tmpl', 'intranet-tmpl', $_) } @intranet_tt_files;
    @opac_tt_files = map { File::Spec->catfile('koha-tmpl', 'opac-tmpl', $_) } @opac_tt_files;
    my @tt_files = grep { -e File::Spec->catfile($tempdir, $_) } @intranet_tt_files, @opac_tt_files;

    push @files_to_scan, @tt_files;

    my $xgettext_common_args = "--force-po --from-code=UTF-8 "
        . "--package-name=Koha --package-version='' "
        . "-k -k__ -k__x -k__n:1,2 -k__nx:1,2 -k__xn:1,2 -k__p:1c,2 "
        . "-k__px:1c,2 -k__np:1c,2,3 -k__npx:1c,2,3 -kN__ -kN__n:1,2 "
        . "-kN__p:1c,2 -kN__np:1c,2,3 ";
    my $xgettext_cmd = "$self->{xgettext} -L Perl $xgettext_common_args "
        . "-o $Bin/$self->{domain}.pot -D $tempdir -D $basedir";
    $xgettext_cmd .= " $_" foreach (@files_to_scan);

    if (system($xgettext_cmd) != 0) {
        die "system call failed: $xgettext_cmd";
    }

    my @js_dirs = (
        "$intrahtdocs/prog/js",
        "$opachtdocs/bootstrap/js",
    );

    my @js_files;
    find(sub {
        if ($_ =~ m/\.js$/) {
            my $filename = $File::Find::name;
            $filename =~ s|^$intranetdir/||;
            push @js_files, $filename;
        }
    }, @js_dirs);

    $xgettext_cmd = "$self->{xgettext} -L JavaScript $xgettext_common_args "
        . "-o $Bin/$self->{domain}-js.pot -D $intranetdir";
    $xgettext_cmd .= " $_" foreach (@js_files);

    if (system($xgettext_cmd) != 0) {
        die "system call failed: $xgettext_cmd";
    }

    my $replace_charset_cmd = "$self->{sed} --in-place " .
        "--expression='s/charset=CHARSET/charset=UTF-8/' " .
        "$Bin/$self->{domain}.pot $Bin/$self->{domain}-js.pot";
    if (system($replace_charset_cmd) != 0) {
        die "system call failed: $replace_charset_cmd";
    }
}

sub install_messages {
    my ($self) = @_;


    my $js_pofile = "$self->{path_po}/$self->{lang}-messages-js.po";

    unless ( -f $pofile && -f $js_pofile ) {
        die "PO files for language '$self->{lang}' do not exist";
    }

    say "Install messages ($locale)" if $self->{verbose};
    make_path($modir);
    system "$self->{msgfmt} -o $mofile $pofile";

    }
}

sub remove_pot {
    my $self = shift;

    unlink "$Bin/$self->{domain}.pot";
    unlink "$Bin/$self->{domain}-js.pot";
}

sub compress {
    my ($self, $files) = @_;
    my @langs = $self->{lang} ? ($self->{lang}) : $self->get_all_langs();

    my ($self, $files) = @_;
    return unless $self->{lang};
    $self->uncompress();

    if ($self->{pref_only}) {
        $self->install_prefs();
    } else {
        $self->install_tmpl($files);
        $self->install_prefs();
        $self->install_messages();
        $self->install_installer();
    }
}



    @files = map { $_ =~ s/-pref.(po|po.gz)$//r } @files;
}


sub update {
    my ($self, $files) = @_;
    my @langs = $self->{lang} ? ($self->{lang}) : $self->get_all_langs();
    for my $lang ( @langs ) {
        $self->set_lang( $lang );
        $self->uncompress();
        $self->update_tmpl($files) unless $self->{pref_only};
        $self->update_prefs();
        $self->update_messages();
        $self->update_installer();
    }
    $self->remove_pot();
}


sub create {
    my ($self, $files) = @_;
    return unless $self->{lang};
    $self->create_tmpl($files) unless $self->{pref_only};
    $self->create_prefs();
    $self->create_messages();
    $self->remove_pot();
    $self->create_installer();
}



1;



Lines 1-5 Link Here

(-)a/misc/translator/po/dz-pref.po (-1 / +9 lines)
1	msgid ""	1	msgid ""
2	msgstr "Project-Id-Version: PACKAGE VERSION\\nPO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\nLast-Translator: FULL NAME <EMAIL@ADDRESS>\\nLanguage-Team: Koha Translate List <koha-translate@lists.koha-community.org>\\nMIME-Version: 1.0\\nContent-Type: text/plain; charset=UTF-8\\nContent-Transfer-Encoding: 8bit\\nPlural-Forms: nplurals=2; plural=(n > 1);\\n"	2	msgstr ""
		3	"Project-Id-Version: PACKAGE VERSION\n"
		4	"PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
		5	"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
		6	"Language-Team: Koha Translate List <koha-translate@lists.koha-community.org>\n"
		7	"MIME-Version: 1.0\n"
		8	"Content-Type: text/plain; charset=UTF-8\n"
		9	"Content-Transfer-Encoding: 8bit\n"
		10	"Plural-Forms: nplurals=2; plural=(n > 1);\n"
3		11
4	# Accounting	12	# Accounting
5	msgid "accounting.pref"	13	msgid "accounting.pref"

Lines 1-5 Link Here

(-)a/misc/translator/po/gd-pref.po (-1 / +9 lines)
1	msgid ""	1	msgid ""
2	msgstr "Project-Id-Version: PACKAGE VERSION\\nPO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\nLast-Translator: FULL NAME <EMAIL@ADDRESS>\\nLanguage-Team: Koha Translate List <koha-translate@lists.koha-community.org>\\nMIME-Version: 1.0\\nContent-Type: text/plain; charset=UTF-8\\nContent-Transfer-Encoding: 8bit\\nPlural-Forms: nplurals=2; plural=(n > 1);\\n"	2	msgstr ""
		3	"Project-Id-Version: PACKAGE VERSION\n"
		4	"PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
		5	"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
		6	"Language-Team: Koha Translate List <koha-translate@lists.koha-community.org>\n"
		7	"MIME-Version: 1.0\n"
		8	"Content-Type: text/plain; charset=UTF-8\n"
		9	"Content-Transfer-Encoding: 8bit\n"
		10	"Plural-Forms: nplurals=2; plural=(n > 1);\n"
3		11
4	# Accounting	12	# Accounting
5	msgid "accounting.pref"	13	msgid "accounting.pref"

Lines 1-5 Link Here

(-)a/misc/translator/po/lv-pref.po (-1 / +9 lines)
1	msgid ""	1	msgid ""
2	msgstr "Project-Id-Version: PACKAGE VERSION\\nPO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\nLast-Translator: FULL NAME <EMAIL@ADDRESS>\\nLanguage-Team: Koha Translate List <koha-translate@lists.koha-community.org>\\nMIME-Version: 1.0\\nContent-Type: text/plain; charset=UTF-8\\nContent-Transfer-Encoding: 8bit\\nPlural-Forms: nplurals=2; plural=(n > 1);\\n"	2	msgstr ""
		3	"Project-Id-Version: PACKAGE VERSION\n"
		4	"PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
		5	"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
		6	"Language-Team: Koha Translate List <koha-translate@lists.koha-community.org>\n"
		7	"MIME-Version: 1.0\n"
		8	"Content-Type: text/plain; charset=UTF-8\n"
		9	"Content-Transfer-Encoding: 8bit\n"
		10	"Plural-Forms: nplurals=2; plural=(n > 1);\n"
3		11
4	# Accounting	12	# Accounting
5	msgid "accounting.pref"	13	msgid "accounting.pref"

Lines 1-5 Link Here

(-)a/misc/translator/po/te-pref.po (-1 / +9 lines)
1	msgid ""	1	msgid ""
2	msgstr "Project-Id-Version: PACKAGE VERSION\\nPO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\\nLast-Translator: FULL NAME <EMAIL@ADDRESS>\\nLanguage-Team: Koha Translate List <koha-translate@lists.koha-community.org>\\nMIME-Version: 1.0\\nContent-Type: text/plain; charset=UTF-8\\nContent-Transfer-Encoding: 8bit\\nPlural-Forms: nplurals=2; plural=(n > 1);\\n"	2	msgstr ""
		3	"Project-Id-Version: PACKAGE VERSION\n"
		4	"PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
		5	"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
		6	"Language-Team: Koha Translate List <koha-translate@lists.koha-community.org>\n"
		7	"MIME-Version: 1.0\n"
		8	"Content-Type: text/plain; charset=UTF-8\n"
		9	"Content-Transfer-Encoding: 8bit\n"
		10	"Plural-Forms: nplurals=2; plural=(n > 1);\n"
3		11
4	# Accounting	12	# Accounting
5	msgid "accounting.pref"	13	msgid "accounting.pref"




    my($exitcode) = @_;
    my $h = $exitcode? *STDERR: *STDOUT;
    print $h <<EOF;
Usage: $0 install [OPTION]
  or:  $0 update [OPTION]
  or:  $0 install [OPTION]
  or:  $0 --help
Install translated templates.

  -i, --input=SOURCE          Get or update strings from SOURCE directory(s).
                              On create or update can have multiple values.

      --help                  Display this help and exit
  -q, --quiet                 no output to screen (except for errors)

The -o option is ignored for the "create" and "update" actions.
Try `perldoc $0` for perhaps more information.
EOF
    exit($exitcode);

VerboseWarnings::set_application_name($0);
VerboseWarnings::set_pedantic_mode($pedantic_p);

# keep the buggy Locale::PO quiet if it says stupid things
$SIG{__WARN__} = sub {
    my($s) = @_;
    print STDERR $s unless $s =~ /^Strange line in [^:]+: #~/s
    };

my $action = shift or usage_error('You must specify an ACTION.');
usage_error('You must at least specify input and string list filenames.')
    if !@in_dirs || !defined $str_file;

    $charset_out = TmplTokenizer::charset_canon('UTF-8');
    warn "Warning: Charset Out defaulting to $charset_out\n" unless ( $quiet );
}
my $xgettext = './xgettext.pl'; # actual text extractor script
my $st;

if ($action eq 'install') {
    # updates the list. As the list is empty, every entry will be added
    if (!-s $str_file) {
    warn "Removing empty file $str_file\n" unless ( $quiet );
    unlink $str_file || die "$str_file: $!\n";
    }
    die "$str_file: Output file already exists\n" if -f $str_file;
    my($tmph1, $tmpfile1) = tmpnam();
    my($tmph2, $tmpfile2) = tmpnam();
    close $tmph2; # We just want a name
    # Generate the temporary file that acts as <MODULE>/POTFILES.in
    for my $input (@in_files) {
    print $tmph1 "$input\n";
    }
    close $tmph1;
    warn "I $charset_in O $charset_out" unless ( $quiet );
    # Generate the specified po file ($str_file)
    $st = system ($xgettext, '-s', '-f', $tmpfile1, '-o', $tmpfile2,
            (defined $charset_in? ('-I', $charset_in): ()),
            (defined $charset_out? ('-O', $charset_out): ())
    );
    # Run msgmerge so that the pot file looks like a real pot file
    # We need to help msgmerge a bit by pre-creating a dummy po file that has
    # the headers and the "" msgid & msgstr. It will fill in the rest.
    if ($st == 0) {
    # Merge the temporary "pot file" with the specified po file ($str_file)
    # FIXME: msgmerge(1) is a Unix dependency
    # FIXME: need to check the return value
    unless (-f $str_file) {
        open(my $infh, '<', $tmpfile2);
        open(my $outfh, '>', $str_file);
        while (<$infh>) {
        print $outfh $_;
        last if /^\n/s;
        }
        close $infh;
        close $outfh;
    }
    $st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile2 -o - | msgattrib --no-obsolete -o $str_file");
    } else {
    error_normal("Text extraction failed: $xgettext: $!\n", undef);
    error_additional("Will not run msgmerge\n", undef);
    }
    unlink $tmpfile1 || warn_normal("$tmpfile1: unlink failed: $!\n", undef);
    unlink $tmpfile2 || warn_normal("$tmpfile2: unlink failed: $!\n", undef);

} elsif ($action eq 'update') {
    my($tmph1, $tmpfile1) = tmpnam();
    my($tmph2, $tmpfile2) = tmpnam();
    close $tmph2; # We just want a name
    # Generate the temporary file that acts as <MODULE>/POTFILES.in
    for my $input (@in_files) {
    print $tmph1 "$input\n";
    }
    close $tmph1;
    # Generate the temporary file that acts as <MODULE>/<LANG>.pot
    $st = system($xgettext, '-s', '-f', $tmpfile1, '-o', $tmpfile2,
        '--po-mode',
        (defined $charset_in? ('-I', $charset_in): ()),
        (defined $charset_out? ('-O', $charset_out): ()));
    if ($st == 0) {
        # Merge the temporary "pot file" with the specified po file ($str_file)
        # FIXME: msgmerge(1) is a Unix dependency
        # FIXME: need to check the return value
        if ( @filenames ) {
            my ($tmph3, $tmpfile3) = tmpnam();
            $st = system("msgcat $str_file $tmpfile2 > $tmpfile3");
            $st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile3 -o - | msgattrib --no-obsolete -o $str_file")
                unless $st;
        } else {
            $st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile2 -o - | msgattrib --no-obsolete -o $str_file");
        }
    } else {
        error_normal("Text extraction failed: $xgettext: $!\n", undef);
        error_additional("Will not run msgmerge\n", undef);
    }
    unlink $tmpfile1 || warn_normal("$tmpfile1: unlink failed: $!\n", undef);
    unlink $tmpfile2 || warn_normal("$tmpfile2: unlink failed: $!\n", undef);

} elsif ($action eq 'install') {
    if(!defined($out_dir)) {
    usage_error("You must specify an output directory when using the install method.");
    }

Using the PO format also means translators can add their
own comments in the translation files, if necessary.

=item -

Create, update, and install actions are all based on the
same scanner module. This ensures that update and install
have the same idea of what is a translatable string;
attribute names in tags, for example, will not be
accidentally translated.

=back

=head1 NOTES

Anchors are represented by an <AI<n>> notation.
The meaning of this non-standard notation might not be obvious.

The create action calls xgettext.pl to do the actual work;
the update action calls xgettext.pl, msgmerge(1) and msgattrib(1)
to do the actual work.

=head1 BUGS

xgettext.pl must be present in the current directory; both
msgmerge(1) and msgattrib(1) must also be present in the search path.
The script currently does not check carefully whether these
dependent commands are present.

Locale::PO(3) has a lot of bugs. It can neither parse nor
generate GNU PO files properly; a couple of workarounds have
been written in TmplTokenizer and more is likely to be needed
(e.g., to get rid of the "Strange line" warning for #~).

This script may not work in Windows.

There are probably some other bugs too, since this has not been


=head1 SEE ALSO

xgettext.pl,
TmplTokenizer.pm,
msgmerge(1),
Locale::PO(3),
translator_doc.txt

http://www.saas.nsw.edu.au/koha_wiki/index.php?page=DifficultTerms

=cut





my ($cmd, $lang) = @ARGV;
$cmd = lc $cmd;
if ( $cmd =~ /^(install|compress|uncompress)$/ ) {
    my $installer = LangInstaller->new( $lang, $pref, $verbose );
    if ( $lang and not grep( {$_ eq $lang} @{ $installer->{langs} } ) ) {
        print "Unsupported language: $lang\n";
        exit;
    }
    if ( $all ) {
        usage() if $cmd eq 'create';
        for my $lang ( @{$installer->{langs}} ) {
            $installer->set_lang( $lang );
            $installer->$cmd(\@files);


=head1 SYNOPSYS

  translate create fr-FR
  translate update fr-FR
  translate install fr-FR
  translate install fr-FR -f search -f memberentry
  translate -p install fr-FR
  translate install
  translate compress [fr-FR]
  translate uncompress [fr-FR]



In Koha, three categories of information are translated based on standard GNU
.po files: opac templates pages, intranet templates and system preferences. The
script is a wrapper. It allows to quickly install .po files for a
given language or for all available languages.

=head1 USAGE


=over

=item translate create F<lang>

Create 3 .po files in F</misc/translator/po> subdirectory: (1) from opac pages
templates, (2) intranet templates, and (3) from preferences. English 'en'
version of templates and preferences are used as references.

=over

=item F<lang>-opac-{theme}.po

Contains extracted text from english (en) OPAC templates found in
<KOHA_ROOT>/koha-tmpl/opac-tmpl/{theme}/en/ directory.

=item F<lang>-intranet.po

Contains extracted text from english (en) intranet templates found in
<KOHA_ROOT>/koha-tmpl/intranet-tmpl/prog/en/ directory.

=item F<lang>-pref.po

Contains extracted text from english (en) preferences. They are found in files
located in <KOHA_ROOT>/koha-tmpl/intranet-tmpl/prog/en/admin/preferences
directory.

=back

=item translate [-p] update F<lang>

Update .po files in F<po> directory, named F<lang>-*.po. Without F<lang>, all
available languages are updated. With -p option, only preferences .po file is
updated.

=item translate [-p|-f] install F<lang>

Use .po files to translate the english version of templates and preferences files




#!/usr/bin/perl

=head1 NAME

xgettext-installer - extract translatable strings from installer YAML files

=head1 SYNOPSIS

xgettext-installer [OPTION] [INPUTFILE]...

=head1 OPTIONS

=over

=item B<-f, --files-from=FILE>

get list of input files from FILE

=item B<-o, --output=FILE>

write output to the specified file

=item B<-h, --help>

display this help and exit

=back

=cut

use Modern::Perl;

use Getopt::Long;
use Locale::PO;
use Pod::Usage;
use YAML::Syck qw(LoadFile);

$YAML::Syck::ImplicitTyping = 1;

my $output = 'messages.pot';
my $files_from;
my $help;

GetOptions(
    'output=s' => \$output,
    'files-from=s' => \$files_from,
    'help' => \$help,
) or pod2usage(-verbose => 1, -exitval => 2);

if ($help) {
    pod2usage(-verbose => 1, -exitval => 0);
}

my @files = @ARGV;
if ($files_from) {
    open(my $fh, '<', $files_from) or die "Cannot open $files_from: $!";
    push @files, <$fh>;
    chomp @files;
    close $fh;
}

my $pot = {
    '' => Locale::PO->new(
        -msgid  => '',
        -msgstr =>
            "Project-Id-Version: Koha\n"
          . "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
          . "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\n"
          . "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\n"
          . "MIME-Version: 1.0\n"
          . "Content-Type: text/plain; charset=UTF-8\n"
          . "Content-Transfer-Encoding: 8bit\n"
    ),
};

for my $file (@files) {
    my $yaml = LoadFile($file);
    my @tables = @{ $yaml->{'tables'} };

    my $tablec = 0;
    for my $table (@tables) {
        $tablec++;

        my $table_name = ( keys %$table )[0];
        my @translatable = @{ $table->{$table_name}->{translatable} };
        my @rows = @{ $table->{$table_name}->{rows} };
        my @multiline = @{ $table->{$table_name}->{'multiline'} };

        my $rowc = 0;
        for my $row (@rows) {
            $rowc++;

            for my $field (@translatable) {
                if ( @multiline and grep { $_ eq $field } @multiline ) {
                    # multiline fields, only notices ATM
                    my $mulc;
                    foreach my $line ( @{ $row->{$field} } ) {
                        $mulc++;

                        # discard pure html, TT, empty
                        next if ( $line =~ /^(\s*<.*?>\s*$|^\s*\[.*?\]\s*|\s*)$/ );

                        # put placeholders
                        $line =~ s/(<<.*?>>|\[\%.*?\%\]|<.*?>)/\%s/g;

                        # discard non strings
                        next if ( $line =~ /^(\s|%s|-|[[:punct:]]|\(|\))*$/ or length($line) < 2 );
                        if ( not $pot->{$line} ) {
                            my $msg = new Locale::PO(
                                -msgid  => $line,
                                -msgstr => '',
                                -reference => "$file:$table_name:$tablec:row:$rowc:mul:$mulc"
                            );
                            $pot->{$line} = $msg;
                        }
                    }
                } elsif (defined $row->{$field} && length($row->{$field}) > 1 && !$pot->{ $row->{$field} }) {
                    my $msg = new Locale::PO(
                        -msgid     => $row->{$field},
                        -msgstr    => '',
                        -reference => "$file:$table_name:$tablec:row:$rowc"
                    );
                    $pot->{ $row->{$field} } = $msg;
                }
            }
        }
    }

    my $desccount = 0;
    for my $description ( @{ $yaml->{'description'} } ) {
        $desccount++;
        if ( length($description) > 1 and not $pot->{$description} ) {
            my $msg = new Locale::PO(
                -msgid     => $description,
                -msgstr    => '',
                -reference => "$file:description:$desccount"
            );
            $pot->{$description} = $msg;
        }
    }
}

Locale::PO->save_file_fromhash($output, $pot);




#!/usr/bin/perl

=head1 NAME

xgettext-pref - extract translatable strings from system preferences YAML files

=head1 SYNOPSIS

xgettext-pref [OPTION] [INPUTFILE]...

=head1 OPTIONS

=over

=item B<-f, --files-from=FILE>

get list of input files from FILE

=item B<-o, --output=FILE>

write output to the specified file

=item B<-h, --help>

display this help and exit

=back

=cut

use Modern::Perl;

use Getopt::Long;
use Locale::PO;
use Pod::Usage;
use YAML::Syck qw(LoadFile);

$YAML::Syck::ImplicitTyping = 1;

my $output = 'messages.pot';
my $files_from;
my $help;

GetOptions(
    'output=s' => \$output,
    'files-from=s' => \$files_from,
    'help' => \$help,
) or pod2usage(-verbose => 1, -exitval => 2);

if ($help) {
    pod2usage(-verbose => 1, -exitval => 0);
}

my @files = @ARGV;
if ($files_from) {
    open(my $fh, '<', $files_from) or die "Cannot open $files_from: $!";
    push @files, <$fh>;
    chomp @files;
    close $fh;
}

my $pot = {
    '' => Locale::PO->new(
        -msgid  => '',
        -msgstr => "Project-Id-Version: Koha\n"
          . "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
          . "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\n"
          . "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\n"
          . "MIME-Version: 1.0\n"
          . "Content-Type: text/plain; charset=UTF-8\n"
          . "Content-Transfer-Encoding: 8bit\n"
    ),
};

for my $file (@files) {
    my $pref = LoadFile($file);
    while ( my ($tab, $tab_content) = each %$pref ) {
        add_po($file, undef, $tab);

        if ( ref($tab_content) eq 'ARRAY' ) {
            add_prefs( $file, $tab, $tab_content );
        } else {
            while ( my ($section, $sysprefs) = each %$tab_content ) {
                my $context = "$tab > $section";
                add_po($file, $tab, $section);
                add_prefs( $file, $context, $sysprefs );
            }
        }
    }
}

Locale::PO->save_file_fromhash($output, $pot);

sub add_prefs {
    my ($file, $context, $prefs) = @_;

    for my $pref (@$prefs) {
        my $pref_name = '';
        for my $element (@$pref) {
            if ( ref($element) eq 'HASH' ) {
                $pref_name = $element->{pref};
                last;
            }
        }
        for my $element (@$pref) {
            if ( ref($element) eq 'HASH' ) {
                while ( my ( $key, $value ) = each(%$element) ) {
                    next unless $key eq 'choices' or $key eq 'multiple';
                    next unless ref($value) eq 'HASH';
                    for my $ckey ( keys %$value ) {
                        add_po( $file, "$context > $pref_name", $value->{$ckey} );
                    }
                }
            }
            elsif ($element) {
                add_po( $file, "$context > $pref_name", $element );
            }
        }
    }
}

sub add_po {
    my ( $reference, $msgctxt, $msgid ) = @_;

    return unless $msgid;

    my $key = ($msgctxt // '') . ";$msgid";
    $pot->{$key} = Locale::PO->new(
        -reference => $reference,
        -msgctxt   => $msgctxt,
        -msgid     => $msgid,
        -msgstr    => '',
    );
}




#!/usr/bin/perl

use Modern::Perl;

my $xgettext = Locale::XGettext::TT2::Koha->newFromArgv(\@ARGV);
$xgettext->setOption('plug_in', '');
$xgettext->run;
$xgettext->output;

package Locale::XGettext::TT2::Koha;

use parent 'Locale::XGettext::TT2';

sub defaultKeywords {
    return [
        't:1',
        'tx:1',
        'tn:1,2',
        'tnx:1,2',
        'txn:1,2',
        'tp:1c,2',
        'tpx:1c,2',
        'tnp:1c,2,3',
        'tnpx:1c,2,3',
    ];
}

sub defaultFlags {
    return [
        'tx:1:perl-brace-format',
        'tnx:1:perl-brace-format',
        'tnx:2:perl-brace-format',
        'txn:1:perl-brace-format',
        'txn:2:perl-brace-format',
        'tpx:2:perl-brace-format',
        'tnpx:2:perl-brace-format',
        'tnpx:3:perl-brace-format',
    ],
}

1;

Lines 173-179 EOF Link Here

(-)a/misc/translator/xgettext.pl (-1 / +1 lines)
173	print $OUTPUT <<EOF;	173	print $OUTPUT <<EOF;
174	msgid ""	174	msgid ""
175	msgstr ""	175	msgstr ""
176	"Project-Id-Version: PACKAGE VERSION\\n"	176	"Project-Id-Version: Koha\\n"
177	"POT-Creation-Date: $time_pot\\n"	177	"POT-Creation-Date: $time_pot\\n"
178	"PO-Revision-Date: $time_po\\n"	178	"PO-Revision-Date: $time_po\\n"
179	"Last-Translator: FULL NAME <EMAIL\@ADDRESS>\\n"	179	"Last-Translator: FULL NAME <EMAIL\@ADDRESS>\\n"

Lines 9-17 Link Here

(-)a/package.json (+3 lines)
9	"dependencies": {	9	"dependencies": {
10	"gulp": "^4.0.2",	10	"gulp": "^4.0.2",
11	"gulp-autoprefixer": "^4.0.0",	11	"gulp-autoprefixer": "^4.0.0",
		12	"gulp-concat-po": "^1.0.0",
12	"gulp-cssnano": "^2.1.2",	13	"gulp-cssnano": "^2.1.2",
		14	"gulp-exec": "^4.0.0",
13	"gulp-sass": "^3.1.0",	15	"gulp-sass": "^3.1.0",
14	"gulp-sourcemaps": "^2.6.1",	16	"gulp-sourcemaps": "^2.6.1",
		17	"merge-stream": "^2.0.0",
15	"minimist": "^1.2.5"	18	"minimist": "^1.2.5"
16	},	19	},
17	"devDependencies": {},	20	"devDependencies": {},




use Modern::Perl;

use FindBin '$Bin';
use lib "$Bin/../misc/translator";

use Test::More tests => 39;
use File::Temp qw(tempdir);
use File::Slurp;
use Locale::PO;

use t::lib::Mocks;

use_ok('LangInstaller');

my $installer = LangInstaller->new();

my $tempdir = tempdir(CLEANUP => 0);
t::lib::Mocks::mock_config('intrahtdocs', "$Bin/LangInstaller/templates");
my @files = ('simple.tt');
$installer->extract_messages_from_templates($tempdir, 'intranet', @files);

my $tempfile = "$tempdir/koha-tmpl/intranet-tmpl/simple.tt";
ok(-e $tempfile, 'it has created a temporary file simple.tt');
SKIP: {
    skip "simple.tt does not exist", 37 unless -e $tempfile;

    my $output = read_file($tempfile);
    my $expected_output = <<'EOF';
__('hello');
__x('hello {name}');
__n('item', 'items');
__nx('{count} item', '{count} items');
__p('context', 'hello');
__px('context', 'hello {name}');
__np('context', 'item', 'items');
__npx('context', '{count} item', '{count} items');
__npx('context', '{count} item', '{count} items');
__x('status is {status}');
__('active');
__('inactive');
__('Inside block');
EOF

    is($output, $expected_output, "Output of extract_messages_from_templates is as expected");

    my $xgettext_cmd = "xgettext -L Perl --from-code=UTF-8 "
        . "--package-name=Koha --package-version='' "
        . "-k -k__ -k__x -k__n:1,2 -k__nx:1,2 -k__xn:1,2 -k__p:1c,2 "
        . "-k__px:1c,2 -k__np:1c,2,3 -k__npx:1c,2,3 "
        . "-o $tempdir/Koha.pot -D $tempdir koha-tmpl/intranet-tmpl/simple.tt";

    system($xgettext_cmd);
    my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");

    my @expected = (
        {
            msgid => '"hello"',
        },
        {
            msgid => '"hello {name}"',
        },
        {
            msgid => '"item"',
            msgid_plural => '"items"',
        },
        {
            msgid => '"{count} item"',
            msgid_plural => '"{count} items"',
        },
        {
            msgid => '"hello"',
            msgctxt => '"context"',
        },
        {
            msgid => '"hello {name}"',
            msgctxt => '"context"',
        },
        {
            msgid => '"item"',
            msgid_plural => '"items"',
            msgctxt => '"context"',
        },
        {
            msgid => '"{count} item"',
            msgid_plural => '"{count} items"',
            msgctxt => '"context"',
        },
        {
            msgid => '"status is {status}"',
        },
        {
            msgid => '"active"',
        },
        {
            msgid => '"inactive"',
        },
        {
            msgid => '"Inside block"',
        },
    );

    for (my $i = 0; $i < @expected; $i++) {
        for my $key (qw(msgid msgid_plural msgctxt)) {
            my $expected = $expected[$i]->{$key};
            my $expected_str = defined $expected ? $expected : 'not defined';
            is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
        }
    }
}




Section:
    Subsection:
        -
            - pref: SamplePref
              choices:
                on: Do
                off: Do not do
            - that thing
        -
            - pref: MultiplePref
              multiple:
                foo: Foo ツ
                bar: Bar
                baz: Baz

Lines 1-6 Link Here

(-)a/t/LangInstaller/templates/simple.tt (-1 / +1 lines)
1	[% USE raw %]	1	[% USE raw %]
2	[% PROCESS 'i18n.inc' %]	2	[% PROCESS 'i18n.inc' %]
3	[% t('hello') \| $raw %]	3	[% t('hello ツ') \| $raw %]
4	[% tx('hello {name}', { name = 'Bob' }) \| $raw %]	4	[% tx('hello {name}', { name = 'Bob' }) \| $raw %]
5	[% tn('item', 'items', count) \| $raw %]	5	[% tn('item', 'items', count) \| $raw %]
6	[% tnx('{count} item', '{count} items', count, { count = count }) \| $raw %]	6	[% tnx('{count} item', '{count} items', count, { count = count }) \| $raw %]




description:
  - "Sample installer file"

tables:
  - table1:
        translatable: [ column1, column2 ]
        multiline: [ column2 ]
        rows:
          - column1: foo ツ
            column2:
              - bar
              - baz
            column3: qux
            column4:
              - quux




#!/usr/bin/perl

use Modern::Perl;

use File::Slurp;
use File::Temp qw(tempdir);
use FindBin qw($Bin);
use Locale::PO;
use Test::More tests => 4;

my $tempdir = tempdir(CLEANUP => 1);

write_file("$tempdir/files", "$Bin/sample.yml");

my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-installer "
    . "-o $tempdir/Koha.pot -f $tempdir/files";

system($xgettext_cmd);
my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");

my @expected = (
    { msgid => '"Sample installer file"' },
    { msgid => '"bar"' },
    { msgid => '"baz"' },
    { msgid => '"foo ツ"' },
);

for (my $i = 0; $i < @expected; $i++) {
    my $expected = $expected[$i]->{msgid};
    my $expected_str = defined $expected ? $expected : 'not defined';
    is($pot->[$i + 1]->msgid, $expected, "$i: msgid is $expected_str");
}




#!/usr/bin/perl

use Modern::Perl;

use File::Slurp;
use File::Temp qw(tempdir);
use FindBin qw($Bin);
use Locale::PO;
use Test::More tests => 16;

my $tempdir = tempdir(CLEANUP => 1);

write_file("$tempdir/files", "$Bin/sample.pref");

my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-pref "
    . "-o $tempdir/Koha.pot -f $tempdir/files";

system($xgettext_cmd);
my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");

my @expected = (
    {
        msgid => '"Section"',
    },
    {
        msgctxt => '"Section > Subsection > MultiplePref"',
        msgid => '"Bar"',
    },
    {
        msgctxt => '"Section > Subsection > MultiplePref"',
        msgid => '"Baz"',
    },
    {
        msgctxt => '"Section > Subsection > MultiplePref"',
        msgid => '"Foo ツ"',
    },
    {
        msgctxt => '"Section > Subsection > SamplePref"',
        msgid => '"Do"',
    },
    {
        msgctxt => '"Section > Subsection > SamplePref"',
        msgid => '"Do not do"',
    },
    {
        msgctxt => '"Section > Subsection > SamplePref"',
        msgid => '"that thing"',
    },
    {
        msgctxt => '"Section"',
        msgid => '"Subsection"',
    },
);

for (my $i = 0; $i < @expected; $i++) {
    for my $key (qw(msgid msgctxt)) {
        my $expected = $expected[$i]->{$key};
        my $expected_str = defined $expected ? $expected : 'not defined';
        is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
    }
}




#!/usr/bin/perl

use Modern::Perl;

use File::Slurp;
use File::Temp qw(tempdir);
use FindBin qw($Bin);
use Locale::PO;
use Test::More tests => 36;

my $tempdir = tempdir(CLEANUP => 1);

write_file("$tempdir/files", "$Bin/sample.tt");

my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-tt2 --from-code=UTF-8 "
    . "-o $tempdir/Koha.pot -f $tempdir/files";

system($xgettext_cmd);
my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");

my @expected = (
    {
        msgid => '"hello ツ"',
    },
    {
        msgid => '"hello {name}"',
    },
    {
        msgid => '"item"',
        msgid_plural => '"items"',
    },
    {
        msgid => '"{count} item"',
        msgid_plural => '"{count} items"',
    },
    {
        msgid => '"hello"',
        msgctxt => '"context"',
    },
    {
        msgid => '"hello {name}"',
        msgctxt => '"context"',
    },
    {
        msgid => '"item"',
        msgid_plural => '"items"',
        msgctxt => '"context"',
    },
    {
        msgid => '"{count} item"',
        msgid_plural => '"{count} items"',
        msgctxt => '"context"',
    },
    {
        msgid => '"status is {status}"',
    },
    {
        msgid => '"active"',
    },
    {
        msgid => '"inactive"',
    },
    {
        msgid => '"Inside block"',
    },
);

for (my $i = 0; $i < @expected; $i++) {
    for my $key (qw(msgid msgid_plural msgctxt)) {
        my $expected = $expected[$i]->{$key};
        my $expected_str = defined $expected ? $expected : 'not defined';
        is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
    }
}

Lines 1468-1473 gulp-cli@^2.2.0: Link Here

(-)a/yarn.lock (-8 / +105 lines)
1468	v8flags "^3.2.0"	1468	v8flags "^3.2.0"
1469	yargs "^7.1.0"	1469	yargs "^7.1.0"
1470		1470
		1471	gulp-concat-po@^1.0.0:
		1472	version "1.0.0"
		1473	resolved "https://registry.yarnpkg.com/gulp-concat-po/-/gulp-concat-po-1.0.0.tgz#2fe7b2c12e45a566238e228f63396838013770ae"
		1474	integrity sha512-hFDZrUJcpw10TW3BfptL5W2FV/aMo3M+vxz9YQV4nlMBDAi8gs9/yZYZcYMYfl5XKhjpebSef8nyruoWdlX8Hw==
		1475	dependencies:
		1476	lodash.find "^4.6.0"
		1477	lodash.merge "^4.6.2"
		1478	lodash.uniq "^4.5.0"
		1479	plugin-error "^1.0.1"
		1480	pofile "^1.1.0"
		1481	through2 "^0.6.5"
		1482	vinyl "^2.2.0"
		1483
1471	gulp-cssnano@^2.1.2:	1484	gulp-cssnano@^2.1.2:
1472	version "2.1.3"	1485	version "2.1.3"
1473	resolved "https://registry.yarnpkg.com/gulp-cssnano/-/gulp-cssnano-2.1.3.tgz#02007e2817af09b3688482b430ad7db807aebf72"	1486	resolved "https://registry.yarnpkg.com/gulp-cssnano/-/gulp-cssnano-2.1.3.tgz#02007e2817af09b3688482b430ad7db807aebf72"
Lines 1479-1484 gulp-cssnano@^2.1.2: Link Here
1479	plugin-error "^1.0.1"	1492	plugin-error "^1.0.1"
1480	vinyl-sourcemaps-apply "^0.2.1"	1493	vinyl-sourcemaps-apply "^0.2.1"
1481		1494
		1495	gulp-exec@^4.0.0:
		1496	version "4.0.0"
		1497	resolved "https://registry.yarnpkg.com/gulp-exec/-/gulp-exec-4.0.0.tgz#4b6b67be0200d620143f3198a64257b68b146bb6"
		1498	integrity sha512-A9JvTyB3P4huusd/43bTr6SDg3MqBxL9AQbLnsKSO6/91wVkHfxgeJZlgDMkqK8sMel4so8wcko4SZOeB1UCgA==
		1499	dependencies:
		1500	lodash.template "^4.4.0"
		1501	plugin-error "^1.0.1"
		1502	through2 "^3.0.1"
		1503
1482	gulp-sass@^3.1.0:	1504	gulp-sass@^3.1.0:
1483	version "3.2.1"	1505	version "3.2.1"
1484	resolved "https://registry.yarnpkg.com/gulp-sass/-/gulp-sass-3.2.1.tgz#2e3688a96fd8be1c0c01340750c191b2e79fab94"	1506	resolved "https://registry.yarnpkg.com/gulp-sass/-/gulp-sass-3.2.1.tgz#2e3688a96fd8be1c0c01340750c191b2e79fab94"
Lines 2130-2135 lodash.escape@^3.0.0: Link Here
2130	dependencies:	2152	dependencies:
2131	lodash._root "^3.0.0"	2153	lodash._root "^3.0.0"
2132		2154
		2155	lodash.find@^4.6.0:
		2156	version "4.6.0"
		2157	resolved "https://registry.yarnpkg.com/lodash.find/-/lodash.find-4.6.0.tgz#cb0704d47ab71789ffa0de8b97dd926fb88b13b1"
		2158	integrity sha1-ywcE1Hq3F4n/oN6Ll92Sb7iLE7E=
		2159
2133	lodash.isarguments@^3.0.0:	2160	lodash.isarguments@^3.0.0:
2134	version "3.1.0"	2161	version "3.1.0"
2135	resolved "https://registry.yarnpkg.com/lodash.isarguments/-/lodash.isarguments-3.1.0.tgz#2f573d85c6a24289ff00663b491c1d338ff3458a"	2162	resolved "https://registry.yarnpkg.com/lodash.isarguments/-/lodash.isarguments-3.1.0.tgz#2f573d85c6a24289ff00663b491c1d338ff3458a"
Lines 2154-2159 lodash.memoize@^4.1.2: Link Here
2154	resolved "https://registry.yarnpkg.com/lodash.memoize/-/lodash.memoize-4.1.2.tgz#bcc6c49a42a2840ed997f323eada5ecd182e0bfe"	2181	resolved "https://registry.yarnpkg.com/lodash.memoize/-/lodash.memoize-4.1.2.tgz#bcc6c49a42a2840ed997f323eada5ecd182e0bfe"
2155	integrity sha1-vMbEmkKihA7Zl/Mj6tpezRguC/4=	2182	integrity sha1-vMbEmkKihA7Zl/Mj6tpezRguC/4=
2156		2183
		2184	lodash.merge@^4.6.2:
		2185	version "4.6.2"
		2186	resolved "https://registry.yarnpkg.com/lodash.merge/-/lodash.merge-4.6.2.tgz#558aa53b43b661e1925a0afdfa36a9a1085fe57a"
		2187	integrity sha512-0KpjqXRVvrYyCsX1swR/XTK0va6VQkQM6MNo7PqW77ByjAhoARA8EfrP1N4+KlKj8YS0ZUCtRT/YUuhyYDujIQ==
		2188
2157	lodash.restparam@^3.0.0:	2189	lodash.restparam@^3.0.0:
2158	version "3.6.1"	2190	version "3.6.1"
2159	resolved "https://registry.yarnpkg.com/lodash.restparam/-/lodash.restparam-3.6.1.tgz#936a4e309ef330a7645ed4145986c85ae5b20805"	2191	resolved "https://registry.yarnpkg.com/lodash.restparam/-/lodash.restparam-3.6.1.tgz#936a4e309ef330a7645ed4145986c85ae5b20805"
Lines 2174-2179 lodash.template@^3.0.0: Link Here
2174	lodash.restparam "^3.0.0"	2206	lodash.restparam "^3.0.0"
2175	lodash.templatesettings "^3.0.0"	2207	lodash.templatesettings "^3.0.0"
2176		2208
		2209	lodash.template@^4.4.0:
		2210	version "4.5.0"
		2211	resolved "https://registry.yarnpkg.com/lodash.template/-/lodash.template-4.5.0.tgz#f976195cf3f347d0d5f52483569fe8031ccce8ab"
		2212	integrity sha512-84vYFxIkmidUiFxidA/KjjH9pAycqW+h980j7Fuz5qxRtO9pgB7MDFTdys1N7A5mcucRiDyEq4fusljItR1T/A==
		2213	dependencies:
		2214	lodash._reinterpolate "^3.0.0"
		2215	lodash.templatesettings "^4.0.0"
		2216
2177	lodash.templatesettings@^3.0.0:	2217	lodash.templatesettings@^3.0.0:
2178	version "3.1.1"	2218	version "3.1.1"
2179	resolved "https://registry.yarnpkg.com/lodash.templatesettings/-/lodash.templatesettings-3.1.1.tgz#fb307844753b66b9f1afa54e262c745307dba8e5"	2219	resolved "https://registry.yarnpkg.com/lodash.templatesettings/-/lodash.templatesettings-3.1.1.tgz#fb307844753b66b9f1afa54e262c745307dba8e5"
Lines 2182-2187 lodash.templatesettings@^3.0.0: Link Here
2182	lodash._reinterpolate "^3.0.0"	2222	lodash._reinterpolate "^3.0.0"
2183	lodash.escape "^3.0.0"	2223	lodash.escape "^3.0.0"
2184		2224
		2225	lodash.templatesettings@^4.0.0:
		2226	version "4.2.0"
		2227	resolved "https://registry.yarnpkg.com/lodash.templatesettings/-/lodash.templatesettings-4.2.0.tgz#e481310f049d3cf6d47e912ad09313b154f0fb33"
		2228	integrity sha512-stgLz+i3Aa9mZgnjr/O+v9ruKZsPsndy7qPZOchbqk2cnTU1ZaldKK+v7m54WoKIyxiuMZTKT2H81F8BeAc3ZQ==
		2229	dependencies:
		2230	lodash._reinterpolate "^3.0.0"
		2231
2185	lodash.uniq@^4.5.0:	2232	lodash.uniq@^4.5.0:
2186	version "4.5.0"	2233	version "4.5.0"
2187	resolved "https://registry.yarnpkg.com/lodash.uniq/-/lodash.uniq-4.5.0.tgz#d0225373aeb652adc1bc82e4945339a842754773"	2234	resolved "https://registry.yarnpkg.com/lodash.uniq/-/lodash.uniq-4.5.0.tgz#d0225373aeb652adc1bc82e4945339a842754773"
Lines 2284-2289 meow@^3.7.0: Link Here
2284	redent "^1.0.0"	2331	redent "^1.0.0"
2285	trim-newlines "^1.0.0"	2332	trim-newlines "^1.0.0"
2286		2333
		2334	merge-stream@^2.0.0:
		2335	version "2.0.0"
		2336	resolved "https://registry.yarnpkg.com/merge-stream/-/merge-stream-2.0.0.tgz#52823629a14dd00c9770fb6ad47dc6310f2c1f60"
		2337	integrity sha512-abv/qOcuPfk3URPfDzmZU1LKmuw8kT+0nIHvKrKgFrwifol/doWcdA4ZqsWQ8ENrFKkd67Mfpo/LovbIUsbt3w==
		2338
2287	micromatch@^3.0.4, micromatch@^3.1.10, micromatch@^3.1.4:	2339	micromatch@^3.0.4, micromatch@^3.1.10, micromatch@^3.1.4:
2288	version "3.1.10"	2340	version "3.1.10"
2289	resolved "https://registry.yarnpkg.com/micromatch/-/micromatch-3.1.10.tgz#70859bc95c9840952f359a068a3fc49f9ecfac23"	2341	resolved "https://registry.yarnpkg.com/micromatch/-/micromatch-3.1.10.tgz#70859bc95c9840952f359a068a3fc49f9ecfac23"
Lines 2753-2758 plugin-error@^1.0.1: Link Here
2753	arr-union "^3.1.0"	2805	arr-union "^3.1.0"
2754	extend-shallow "^3.0.2"	2806	extend-shallow "^3.0.2"
2755		2807
		2808	pofile@^1.1.0:
		2809	version "1.1.0"
		2810	resolved "https://registry.yarnpkg.com/pofile/-/pofile-1.1.0.tgz#9ce84bbef5043ceb4f19bdc3520d85778fad4f94"
		2811	integrity sha512-6XYcNkXWGiJ2CVXogTP7uJ6ZXQCldYLZc16wgRp8tqRaBTTyIfF+TUT3EQJPXTLAT7OTPpTAoaFdoXKfaTRU1w==
		2812
2756	posix-character-classes@^0.1.0:	2813	posix-character-classes@^0.1.0:
2757	version "0.1.1"	2814	version "0.1.1"
2758	resolved "https://registry.yarnpkg.com/posix-character-classes/-/posix-character-classes-0.1.1.tgz#01eac0fe3b5af71a2a6c02feabb8c1fef7e00eab"	2815	resolved "https://registry.yarnpkg.com/posix-character-classes/-/posix-character-classes-0.1.1.tgz#01eac0fe3b5af71a2a6c02feabb8c1fef7e00eab"
Lines 3093-3098 read-pkg@^1.0.0: Link Here
3093	normalize-package-data "^2.3.2"	3150	normalize-package-data "^2.3.2"
3094	path-type "^1.0.0"	3151	path-type "^1.0.0"
3095		3152
		3153	"readable-stream@2 \|\| 3":
		3154	version "3.6.0"
		3155	resolved "https://registry.yarnpkg.com/readable-stream/-/readable-stream-3.6.0.tgz#337bbda3adc0706bd3e024426a286d4b4b2c9198"
		3156	integrity sha512-BViHy7LKeTz4oNnkcLJ+lVSL6vpiFeX6/d3oSH8zCW7UxP2onchk+vTGB143xuFjHS3deTgkKoXXymXqymiIdA==
		3157	dependencies:
		3158	inherits "^2.0.3"
		3159	string_decoder "^1.1.1"
		3160	util-deprecate "^1.0.1"
		3161
		3162	"readable-stream@>=1.0.33-1 <1.1.0-0":
		3163	version "1.0.34"
		3164	resolved "https://registry.yarnpkg.com/readable-stream/-/readable-stream-1.0.34.tgz#125820e34bc842d2f2aaafafe4c2916ee32c157c"
		3165	integrity sha1-Elgg40vIQtLyqq+v5MKRbuMsFXw=
		3166	dependencies:
		3167	core-util-is "~1.0.0"
		3168	inherits "~2.0.1"
		3169	isarray "0.0.1"
		3170	string_decoder "~0.10.x"
		3171
3096	readable-stream@^2.0.0, readable-stream@^2.0.2, readable-stream@^2.0.5, readable-stream@^2.1.5, readable-stream@^2.2.2, readable-stream@^2.3.3, readable-stream@^2.3.5, readable-stream@^2.3.6:	3172	readable-stream@^2.0.0, readable-stream@^2.0.2, readable-stream@^2.0.5, readable-stream@^2.1.5, readable-stream@^2.2.2, readable-stream@^2.3.3, readable-stream@^2.3.5, readable-stream@^2.3.6:
3097	version "2.3.7"	3173	version "2.3.7"
3098	resolved "https://registry.yarnpkg.com/readable-stream/-/readable-stream-2.3.7.tgz#1eca1cf711aef814c04f62252a36a62f6cb23b57"	3174	resolved "https://registry.yarnpkg.com/readable-stream/-/readable-stream-2.3.7.tgz#1eca1cf711aef814c04f62252a36a62f6cb23b57"
Lines 3222-3230 replace-ext@0.0.1: Link Here
3222	integrity sha1-KbvZIHinOfC8zitO5B6DeVNSKSQ=	3298	integrity sha1-KbvZIHinOfC8zitO5B6DeVNSKSQ=
3223		3299
3224	replace-ext@^1.0.0:	3300	replace-ext@^1.0.0:
3225	version "1.0.1"	3301	version "1.0.0"
3226	resolved "https://registry.yarnpkg.com/replace-ext/-/replace-ext-1.0.1.tgz#2d6d996d04a15855d967443631dd5f77825b016a"	3302	resolved "https://registry.yarnpkg.com/replace-ext/-/replace-ext-1.0.0.tgz#de63128373fcbf7c3ccfa4de5a480c45a67958eb"
3227	integrity sha512-yD5BHCe7quCgBph4rMQ+0KkIRKwWCrHDOX1p1Gp6HwjPM5kVoCdKGNhN7ydqqsX6lJEnQDKZ/tFMiEdQ1dvPEw==	3303	integrity sha1-3mMSg3P8v3w8z6TeWkgMRaZ5WOs=
3228		3304
3229	replace-homedir@^1.0.0:	3305	replace-homedir@^1.0.0:
3230	version "1.0.0"	3306	version "1.0.0"
Lines 3317-3323 rimraf@2: Link Here
3317	dependencies:	3393	dependencies:
3318	glob "^7.1.3"	3394	glob "^7.1.3"
3319		3395
3320	safe-buffer@^5.0.1, safe-buffer@^5.1.2:	3396	safe-buffer@^5.0.1, safe-buffer@^5.1.2, safe-buffer@~5.2.0:
3321	version "5.2.0"	3397	version "5.2.0"
3322	resolved "https://registry.yarnpkg.com/safe-buffer/-/safe-buffer-5.2.0.tgz#b74daec49b1148f88c64b68d49b1e815c1f2f519"	3398	resolved "https://registry.yarnpkg.com/safe-buffer/-/safe-buffer-5.2.0.tgz#b74daec49b1148f88c64b68d49b1e815c1f2f519"
3323	integrity sha512-fZEwUGbVl7kouZs1jCdMLdt95hdIv0ZeHg6L7qPeciMZhZ+/gdesW4wgTARkrFWEpspjEATAzUGPG8N2jJiwbg==	3399	integrity sha512-fZEwUGbVl7kouZs1jCdMLdt95hdIv0ZeHg6L7qPeciMZhZ+/gdesW4wgTARkrFWEpspjEATAzUGPG8N2jJiwbg==
Lines 3595-3600 string-width@^1.0.1, string-width@^1.0.2: Link Here
3595	is-fullwidth-code-point "^2.0.0"	3671	is-fullwidth-code-point "^2.0.0"
3596	strip-ansi "^4.0.0"	3672	strip-ansi "^4.0.0"
3597		3673
		3674	string_decoder@^1.1.1:
		3675	version "1.3.0"
		3676	resolved "https://registry.yarnpkg.com/string_decoder/-/string_decoder-1.3.0.tgz#42f114594a46cf1a8e30b0a84f56c78c3edac21e"
		3677	integrity sha512-hkRX8U1WjJFd8LsDJ2yQ/wWWxaopEsABU1XfkM8A+j0+85JAGppt16cr1Whg6KIbb4okU6Mql6BOj+uup/wKeA==
		3678	dependencies:
		3679	safe-buffer "~5.2.0"
		3680
3598	string_decoder@~0.10.x:	3681	string_decoder@~0.10.x:
3599	version "0.10.31"	3682	version "0.10.31"
3600	resolved "https://registry.yarnpkg.com/string_decoder/-/string_decoder-0.10.31.tgz#62e203bc41766c6c28c9fc84301dab1c5310fa94"	3683	resolved "https://registry.yarnpkg.com/string_decoder/-/string_decoder-0.10.31.tgz#62e203bc41766c6c28c9fc84301dab1c5310fa94"
Lines 3705-3710 through2@2.X, through2@^2.0.0, through2@^2.0.3, through2@~2.0.0: Link Here
3705	readable-stream "~2.3.6"	3788	readable-stream "~2.3.6"
3706	xtend "~4.0.1"	3789	xtend "~4.0.1"
3707		3790
		3791	through2@^0.6.5:
		3792	version "0.6.5"
		3793	resolved "https://registry.yarnpkg.com/through2/-/through2-0.6.5.tgz#41ab9c67b29d57209071410e1d7a7a968cd3ad48"
		3794	integrity sha1-QaucZ7KdVyCQcUEOHXp6lozTrUg=
		3795	dependencies:
		3796	readable-stream ">=1.0.33-1 <1.1.0-0"
		3797	xtend ">=4.0.0 <4.1.0-0"
		3798
		3799	through2@^3.0.1:
		3800	version "3.0.1"
		3801	resolved "https://registry.yarnpkg.com/through2/-/through2-3.0.1.tgz#39276e713c3302edf9e388dd9c812dd3b825bd5a"
		3802	integrity sha512-M96dvTalPT3YbYLaKaCuwu+j06D/8Jfib0o/PxbVt6Amhv3dUAtW6rTV1jPgJSBG83I/e04Y6xkVdVhSRhi0ww==
		3803	dependencies:
		3804	readable-stream "2 \|\| 3"
		3805
3708	time-stamp@^1.0.0:	3806	time-stamp@^1.0.0:
3709	version "1.1.0"	3807	version "1.1.0"
3710	resolved "https://registry.yarnpkg.com/time-stamp/-/time-stamp-1.1.0.tgz#764a5a11af50561921b133f3b44e618687e0f5c3"	3808	resolved "https://registry.yarnpkg.com/time-stamp/-/time-stamp-1.1.0.tgz#764a5a11af50561921b133f3b44e618687e0f5c3"
Lines 3889-3895 use@^3.1.0: Link Here
3889	resolved "https://registry.yarnpkg.com/use/-/use-3.1.1.tgz#d50c8cac79a19fbc20f2911f56eb973f4e10070f"	3987	resolved "https://registry.yarnpkg.com/use/-/use-3.1.1.tgz#d50c8cac79a19fbc20f2911f56eb973f4e10070f"
3890	integrity sha512-cwESVXlO3url9YWlFW/TA9cshCEhtu7IKJ/p5soJ/gGpj7vbvFrAY/eIioQ6Dw23KjZhYgiIo8HOs1nQ2vr/oQ==	3988	integrity sha512-cwESVXlO3url9YWlFW/TA9cshCEhtu7IKJ/p5soJ/gGpj7vbvFrAY/eIioQ6Dw23KjZhYgiIo8HOs1nQ2vr/oQ==
3891		3989
3892	util-deprecate@~1.0.1:	3990	util-deprecate@^1.0.1, util-deprecate@~1.0.1:
3893	version "1.0.2"	3991	version "1.0.2"
3894	resolved "https://registry.yarnpkg.com/util-deprecate/-/util-deprecate-1.0.2.tgz#450d4dc9fa70de732762fbd2d4a28981419a0ccf"	3992	resolved "https://registry.yarnpkg.com/util-deprecate/-/util-deprecate-1.0.2.tgz#450d4dc9fa70de732762fbd2d4a28981419a0ccf"
3895	integrity sha1-RQ1Nyfpw3nMnYvvS1KKJgUGaDM8=	3993	integrity sha1-RQ1Nyfpw3nMnYvvS1KKJgUGaDM8=
Lines 3985-3991 vinyl@^0.5.0: Link Here
3985	clone-stats "^0.0.1"	4083	clone-stats "^0.0.1"
3986	replace-ext "0.0.1"	4084	replace-ext "0.0.1"
3987		4085
3988	vinyl@^2.0.0:	4086	vinyl@^2.0.0, vinyl@^2.2.0:
3989	version "2.2.0"	4087	version "2.2.0"
3990	resolved "https://registry.yarnpkg.com/vinyl/-/vinyl-2.2.0.tgz#d85b07da96e458d25b2ffe19fece9f2caa13ed86"	4088	resolved "https://registry.yarnpkg.com/vinyl/-/vinyl-2.2.0.tgz#d85b07da96e458d25b2ffe19fece9f2caa13ed86"
3991	integrity sha512-MBH+yP0kC/GQ5GwBqrTPTzEfiiLjta7hTtvQtbxBgTeSXsmKQRQecjibMbxIXzVT3Y9KJK+drOz1/k+vsu8Nkg==	4089	integrity sha512-MBH+yP0kC/GQ5GwBqrTPTzEfiiLjta7hTtvQtbxBgTeSXsmKQRQecjibMbxIXzVT3Y9KJK+drOz1/k+vsu8Nkg==
Lines 4034-4040 wrappy@1: Link Here
4034	resolved "https://registry.yarnpkg.com/wrappy/-/wrappy-1.0.2.tgz#b5243d8f3ec1aa35f1364605bc0d1036e30ab69f"	4132	resolved "https://registry.yarnpkg.com/wrappy/-/wrappy-1.0.2.tgz#b5243d8f3ec1aa35f1364605bc0d1036e30ab69f"
4035	integrity sha1-tSQ9jz7BqjXxNkYFvA0QNuMKtp8=	4133	integrity sha1-tSQ9jz7BqjXxNkYFvA0QNuMKtp8=
4036		4134
4037	xtend@~4.0.0, xtend@~4.0.1:	4135	"xtend@>=4.0.0 <4.1.0-0", xtend@~4.0.0, xtend@~4.0.1:
4038	version "4.0.2"	4136	version "4.0.2"
4039	resolved "https://registry.yarnpkg.com/xtend/-/xtend-4.0.2.tgz#bb72779f5fa465186b1f438f674fa347fdb5db54"	4137	resolved "https://registry.yarnpkg.com/xtend/-/xtend-4.0.2.tgz#bb72779f5fa465186b1f438f674fa347fdb5db54"
4040	integrity sha512-LKYU1iAXJXUgAXn9URjiu+MWhyUXHsvfp7mcuYm9dSUKK0/CjtrUwFAxD82/mCWbtLsGjFIad0wIsod4zrTAEQ==	4138	integrity sha512-LKYU1iAXJXUgAXn9URjiu+MWhyUXHsvfp7mcuYm9dSUKK0/CjtrUwFAxD82/mCWbtLsGjFIad0wIsod4zrTAEQ==
4041	-

Return to bug 25067

Lines 1-6 Link Here

(-)a/t/LangInstaller/templates/simple.tt (-1 / +1 lines)
1	[% USE raw %]	1	[% USE raw %]
2	[% PROCESS 'i18n.inc' %]	2	[% PROCESS 'i18n.inc' %]
3	[% t('hello') \| $raw %]	3	[% t('hello ツ') \| $raw %]
4	[% tx('hello {name}', { name = 'Bob' }) \| $raw %]	4	[% tx('hello {name}', { name = 'Bob' }) \| $raw %]
5	[% tn('item', 'items', count) \| $raw %]	5	[% tn('item', 'items', count) \| $raw %]
6	[% tnx('{count} item', '{count} items', count, { count = count }) \| $raw %]	6	[% tnx('{count} item', '{count} items', count, { count = count }) \| $raw %]

Lines 143-148 recommends 'Gravatar::URL', '1.03'; Link Here

(-)a/cpanfile (-1 / +1 lines)
143	recommends 'HTTPD::Bench::ApacheBench', '0.73';	143	recommends 'HTTPD::Bench::ApacheBench', '0.73';
144	recommends 'LWP::Protocol::https', '5.836';	144	recommends 'LWP::Protocol::https', '5.836';
145	recommends 'Lingua::Ispell', '0.07';	145	recommends 'Lingua::Ispell', '0.07';
		146	recommends 'Locale::XGettext::TT2', '0.7';
146	recommends 'Module::Bundled::Files', '0.03';	147	recommends 'Module::Bundled::Files', '0.03';
147	recommends 'Module::Load::Conditional', '0.38';	148	recommends 'Module::Load::Conditional', '0.38';
148	recommends 'Module::Pluggable', '3.9';	149	recommends 'Module::Pluggable', '3.9';
Lines 154-160 recommends 'Net::SFTP::Foreign', '1.73'; Link Here
154	recommends 'Net::Server', '0.97';	155	recommends 'Net::Server', '0.97';
155	recommends 'Net::Z3950::SimpleServer', '1.15';	156	recommends 'Net::Z3950::SimpleServer', '1.15';
156	recommends 'PDF::FromHTML', '0.31';	157	recommends 'PDF::FromHTML', '0.31';
157	recommends 'PPI', '1.215';
158	recommends 'Parallel::ForkManager', '0.75';	158	recommends 'Parallel::ForkManager', '0.75';
159	recommends 'Readonly', '0.01';	159	recommends 'Readonly', '0.01';
160	recommends 'Readonly::XS', '0.01';	160	recommends 'Readonly::XS', '0.01';

Line 0 Link Here

(-)a/docs/development/internationalization.md (+121 lines)
		1	# Internationalization
		2
		3	This page documents how internationalization works in Koha.
		4
		5	## Making strings translatable
		6
		7	There are several ways of making a string translatable, depending on where it
		8	is located
		9
		10	### In Template::Toolkit files (`*.tt`)
		11
		12	The simplest way to make a string translatable in a template is to do nothing.
		13	Templates are parsed as HTML files and almost all text nodes are considered as
		14	translatable strings. This also includes some attributes like `title` and
		15	`placeholder`.
		16
		17	This method has some downsides: you don't have full control over what would
		18	appear in PO files and you cannot use plural forms or context. In order to do
		19	that you have to use `i18n.inc`
		20
		21	`i18n.inc` contains several macros that, when used, make a string translatable.
		22	The first thing to do is to make these macros available by adding
		23
		24	[% PROCESS 'i18n.inc' %]
		25
		26	at the top of the template file. Then you can use those macros.
		27
		28	The simplest one is `t(msgid)`
		29
		30	[% t('This is a translatable string') %]
		31
		32	You can also use variable substitution with `tx(msgid, vars)`
		33
		34	[% tx('Hello, {name}', { name = 'World' }) %]
		35
		36	You can use plural forms with `tn(msgid, msgid_plural, count)`
		37
		38	[% tn('a child', 'several children', number_of_children) %]
		39
		40	You can add context, to help translators when a term is ambiguous, with
		41	`tp(msgctxt, msgid)`
		42
		43	[% tp('verb', 'order') %]
		44	[% tp('noun', 'order') %]
		45
		46	Or any combinations of the above
		47
		48	[% tnpx('bibliographic record', '{count} item', '{count} items', items_count, { count = items_count }) %]
		49
		50	### In JavaScript files (`*.js`)
		51
		52	Like in templates, you have several functions available. Just replace `t` by `__`.
		53
		54	__('This is a translatable string');
		55	__npx('bibliographic record, '{count} item', '{count} items', items_count, { count: items_count });
		56
		57	### In Perl files (`.pl`, `.pm`)
		58
		59	You will have to add
		60
		61	use Koha::I18N;
		62
		63	at the top of the file, and then the same functions as above will be available.
		64
65	__('This is a translatable string');
66	__npx('bibliographic record, '{count} item', '{count} items', $items_count, count => $items_count);
67
68	### In installer and preferences YAML files (`*.yml`)
69
70	Nothing special to do here. All strings will be automatically translatable.
71
72	## Manipulating PO files
73
74	Once strings have been made translatable in source files, they have to be
75	extracted into PO files and uploaded on https://translate.koha-community.org/
76	so they can be translated.
77
78	### Install gulp first
79
80	The next sections rely on gulp. If it's not installed, run the following
81	commands:
82
83	# as root
84	npm install gulp-cli -g
85
86	# as normal user, from the root of Koha repository
87	yarn
88
89	### Create PO files for a new language
90
91	If you want to add translations for a new language, you have to create the
92	missing PO files. You can do that by executing the following command:
93
94	# Replace xx-XX by your language tag
95	gulp po:create --lang xx-XX
96
97	New PO files will be available in `misc/translator/po`.
98
99	### Update PO files with new strings
100
101	When new features or bugfixes are added to Koha, new translatable strings can
102	be added, other can be removed or modified, and the PO file become out of sync.
103
104	To be able to translate the new or modified strings, you have to update PO
105	files. This can be done by executing the following command:
106
107	# Update PO files for all languages
108	gulp po:update
109
110	# or only one language
111	gulp po:update --lang xx-XX
112
113	### Only extract strings
114
115	Creating or updating PO files automatically extract strings, but if for some
116	reasons you want to only extract strings without touching PO files, you can run
117	the following command:
118
119	gulp po:extract
120
121	POT files will be available in `misc/translator`.

Lines 204-214 sub usage { Link Here

(-)a/misc/translator/tmpl_process3.pl (-119 / +3 lines)
204	my($exitcode) = @_;	204	my($exitcode) = @_;
205	my $h = $exitcode? STDERR: STDOUT;	205	my $h = $exitcode? STDERR: STDOUT;
206	print $h <<EOF;	206	print $h <<EOF;
207	Usage: $0 create [OPTION]	207	Usage: $0 install [OPTION]
208	or: $0 update [OPTION]
209	or: $0 install [OPTION]
210	or: $0 --help	208	or: $0 --help
211	Create or update PO files from templates, or install translated templates.	209	Install translated templates.
212		210
213	-i, --input=SOURCE Get or update strings from SOURCE directory(s).	211	-i, --input=SOURCE Get or update strings from SOURCE directory(s).
214	On create or update can have multiple values.	212	On create or update can have multiple values.
Lines 230-236 Create or update PO files from templates, or install translated templates. Link Here
230	--help Display this help and exit	228	--help Display this help and exit
231	-q, --quiet no output to screen (except for errors)	229	-q, --quiet no output to screen (except for errors)
232		230
233	The -o option is ignored for the "create" and "update" actions.
234	Try `perldoc $0` for perhaps more information.	231	Try `perldoc $0` for perhaps more information.
235	EOF	232	EOF
236	exit($exitcode);	233	exit($exitcode);
Lines 265-276 GetOptions( Link Here
265	VerboseWarnings::set_application_name($0);	262	VerboseWarnings::set_application_name($0);
266	VerboseWarnings::set_pedantic_mode($pedantic_p);	263	VerboseWarnings::set_pedantic_mode($pedantic_p);
267		264
268	# keep the buggy Locale::PO quiet if it says stupid things
269	$SIG{__WARN__} = sub {
270	my($s) = @_;
271	print STDERR $s unless $s =~ /^Strange line in [^:]+: #~/s
272	};
273
274	my $action = shift or usage_error('You must specify an ACTION.');	265	my $action = shift or usage_error('You must specify an ACTION.');
275	usage_error('You must at least specify input and string list filenames.')	266	usage_error('You must at least specify input and string list filenames.')
276	if !@in_dirs \|\| !defined $str_file;	267	if !@in_dirs \|\| !defined $str_file;
Lines 344-432 if (!defined $charset_out) { Link Here
344	$charset_out = TmplTokenizer::charset_canon('UTF-8');	335	$charset_out = TmplTokenizer::charset_canon('UTF-8');
345	warn "Warning: Charset Out defaulting to $charset_out\n" unless ( $quiet );	336	warn "Warning: Charset Out defaulting to $charset_out\n" unless ( $quiet );
346	}	337	}
347	my $xgettext = './xgettext.pl'; # actual text extractor script
348	my $st;	338	my $st;
349		339
350	if ($action eq 'create') {	340	if ($action eq 'install') {
351	# updates the list. As the list is empty, every entry will be added
352	if (!-s $str_file) {
353	warn "Removing empty file $str_file\n" unless ( $quiet );
354	unlink $str_file \|\| die "$str_file: $!\n";
355	}
356	die "$str_file: Output file already exists\n" if -f $str_file;
357	my($tmph1, $tmpfile1) = tmpnam();
358	my($tmph2, $tmpfile2) = tmpnam();
359	close $tmph2; # We just want a name
360	# Generate the temporary file that acts as <MODULE>/POTFILES.in
361	for my $input (@in_files) {
362	print $tmph1 "$input\n";
363	}
364	close $tmph1;
365	warn "I $charset_in O $charset_out" unless ( $quiet );
366	# Generate the specified po file ($str_file)
367	$st = system ($xgettext, '-s', '-f', $tmpfile1, '-o', $tmpfile2,
368	(defined $charset_in? ('-I', $charset_in): ()),
369	(defined $charset_out? ('-O', $charset_out): ())
370	);
371	# Run msgmerge so that the pot file looks like a real pot file
372	# We need to help msgmerge a bit by pre-creating a dummy po file that has
373	# the headers and the "" msgid & msgstr. It will fill in the rest.
374	if ($st == 0) {
375	# Merge the temporary "pot file" with the specified po file ($str_file)
376	# FIXME: msgmerge(1) is a Unix dependency
377	# FIXME: need to check the return value
378	unless (-f $str_file) {
379	open(my $infh, '<', $tmpfile2);
380	open(my $outfh, '>', $str_file);
381	while (<$infh>) {
382	print $outfh $_;
383	last if /^\n/s;
384	}
385	close $infh;
386	close $outfh;
387	}
388	$st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile2 -o - \| msgattrib --no-obsolete -o $str_file");
389	} else {
390	error_normal("Text extraction failed: $xgettext: $!\n", undef);
391	error_additional("Will not run msgmerge\n", undef);
392	}
393	unlink $tmpfile1 \|\| warn_normal("$tmpfile1: unlink failed: $!\n", undef);
394	unlink $tmpfile2 \|\| warn_normal("$tmpfile2: unlink failed: $!\n", undef);
395
396	} elsif ($action eq 'update') {
397	my($tmph1, $tmpfile1) = tmpnam();
398	my($tmph2, $tmpfile2) = tmpnam();
399	close $tmph2; # We just want a name
400	# Generate the temporary file that acts as <MODULE>/POTFILES.in
401	for my $input (@in_files) {
402	print $tmph1 "$input\n";
403	}
404	close $tmph1;
405	# Generate the temporary file that acts as <MODULE>/<LANG>.pot
406	$st = system($xgettext, '-s', '-f', $tmpfile1, '-o', $tmpfile2,
407	'--po-mode',
408	(defined $charset_in? ('-I', $charset_in): ()),
409	(defined $charset_out? ('-O', $charset_out): ()));
410	if ($st == 0) {
411	# Merge the temporary "pot file" with the specified po file ($str_file)
412	# FIXME: msgmerge(1) is a Unix dependency
413	# FIXME: need to check the return value
414	if ( @filenames ) {
415	my ($tmph3, $tmpfile3) = tmpnam();
416	$st = system("msgcat $str_file $tmpfile2 > $tmpfile3");
417	$st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile3 -o - \| msgattrib --no-obsolete -o $str_file")
418	unless $st;
419	} else {
420	$st = system("msgmerge ".($quiet?'-q':'')." -s $str_file $tmpfile2 -o - \| msgattrib --no-obsolete -o $str_file");
421	}
422	} else {
423	error_normal("Text extraction failed: $xgettext: $!\n", undef);
424	error_additional("Will not run msgmerge\n", undef);
425	}
426	unlink $tmpfile1 \|\| warn_normal("$tmpfile1: unlink failed: $!\n", undef);
427	unlink $tmpfile2 \|\| warn_normal("$tmpfile2: unlink failed: $!\n", undef);
428
429	} elsif ($action eq 'install') {
430	if(!defined($out_dir)) {	341	if(!defined($out_dir)) {
431	usage_error("You must specify an output directory when using the install method.");	342	usage_error("You must specify an output directory when using the install method.");
432	}	343	}
Lines 554-567 translation, it can be suppressed with the %0.0s notation. Link Here
554	Using the PO format also means translators can add their	465	Using the PO format also means translators can add their
555	own comments in the translation files, if necessary.	466	own comments in the translation files, if necessary.
556		467
557	=item -
558
559	Create, update, and install actions are all based on the
560	same scanner module. This ensures that update and install
561	have the same idea of what is a translatable string;
562	attribute names in tags, for example, will not be
563	accidentally translated.
564
565	=back	468	=back
566		469
567	=head1 NOTES	470	=head1 NOTES
Lines 569-590 accidentally translated. Link Here
569	Anchors are represented by an <AI<n>> notation.	472	Anchors are represented by an <AI<n>> notation.
570	The meaning of this non-standard notation might not be obvious.	473	The meaning of this non-standard notation might not be obvious.
571		474
572	The create action calls xgettext.pl to do the actual work;
573	the update action calls xgettext.pl, msgmerge(1) and msgattrib(1)
574	to do the actual work.
575
576	=head1 BUGS	475	=head1 BUGS
577		476
578	xgettext.pl must be present in the current directory; both
579	msgmerge(1) and msgattrib(1) must also be present in the search path.
580	The script currently does not check carefully whether these
581	dependent commands are present.
582
583	Locale::PO(3) has a lot of bugs. It can neither parse nor
584	generate GNU PO files properly; a couple of workarounds have
585	been written in TmplTokenizer and more is likely to be needed
586	(e.g., to get rid of the "Strange line" warning for #~).
587
588	This script may not work in Windows.	477	This script may not work in Windows.
589		478
590	There are probably some other bugs too, since this has not been	479	There are probably some other bugs too, since this has not been
Lines 592-603 tested very much. Link Here
592		481
593	=head1 SEE ALSO	482	=head1 SEE ALSO
594		483
595	xgettext.pl,
596	TmplTokenizer.pm,	484	TmplTokenizer.pm,
597	msgmerge(1),
598	Locale::PO(3),	485	Locale::PO(3),
599	translator_doc.txt
600
601	http://www.saas.nsw.edu.au/koha_wiki/index.php?page=DifficultTerms
602		486
603	=cut	487	=cut

Lines 54-67 usage() if $#ARGV != 1 && $#ARGV != 0; Link Here

(-)a/misc/translator/translate (-39 / +3 lines)
54		54
55	my ($cmd, $lang) = @ARGV;	55	my ($cmd, $lang) = @ARGV;
56	$cmd = lc $cmd;	56	$cmd = lc $cmd;
57	if ( $cmd =~ /^(create\|install\|update\|compress\|uncompress)$/ ) {	57	if ( $cmd =~ /^(install\|compress\|uncompress)$/ ) {
58	my $installer = LangInstaller->new( $lang, $pref, $verbose );	58	my $installer = LangInstaller->new( $lang, $pref, $verbose );
59	if ( $cmd ne 'create' and $lang and not grep( {$_ eq $lang} @{ $installer->{langs} } ) ) {	59	if ( $lang and not grep( {$_ eq $lang} @{ $installer->{langs} } ) ) {
60	print "Unsupported language: $lang\n";	60	print "Unsupported language: $lang\n";
61	exit;	61	exit;
62	}	62	}
63	if ( $all ) {	63	if ( $all ) {
64	usage() if $cmd eq 'create';
65	for my $lang ( @{$installer->{langs}} ) {	64	for my $lang ( @{$installer->{langs}} ) {
66	$installer->set_lang( $lang );	65	$installer->set_lang( $lang );
67	$installer->$cmd(\@files);	66	$installer->$cmd(\@files);
Lines 85-96 translate - Handle templates and preferences translation Link Here
85		84
86	=head1 SYNOPSYS	85	=head1 SYNOPSYS
87		86
88	translate create fr-FR
89	translate update fr-FR
90	translate install fr-FR	87	translate install fr-FR
91	translate install fr-FR -f search -f memberentry	88	translate install fr-FR -f search -f memberentry
92	translate -p install fr-FR	89	translate -p install fr-FR
93	translate install
94	translate compress [fr-FR]	90	translate compress [fr-FR]
95	translate uncompress [fr-FR]	91	translate uncompress [fr-FR]
96		92
Lines 98-104 translate - Handle templates and preferences translation Link Here
98		94
99	In Koha, three categories of information are translated based on standard GNU	95	In Koha, three categories of information are translated based on standard GNU
100	.po files: opac templates pages, intranet templates and system preferences. The	96	.po files: opac templates pages, intranet templates and system preferences. The
101	script is a wrapper. It allows to quickly create/update/install .po files for a	97	script is a wrapper. It allows to quickly install .po files for a
102	given language or for all available languages.	98	given language or for all available languages.
103		99
104	=head1 USAGE	100	=head1 USAGE
Lines 107-144 Use the -v or --verbose parameter to make translator more verbose. Link Here
107		103
108	=over	104	=over
109		105
110	=item translate create F<lang>
111
112	Create 3 .po files in F</misc/translator/po> subdirectory: (1) from opac pages
113	templates, (2) intranet templates, and (3) from preferences. English 'en'
114	version of templates and preferences are used as references.
115
116	=over
117
118	=item F<lang>-opac-{theme}.po
119
120	Contains extracted text from english (en) OPAC templates found in
121	<KOHA_ROOT>/koha-tmpl/opac-tmpl/{theme}/en/ directory.
122
123	=item F<lang>-intranet.po
124
125	Contains extracted text from english (en) intranet templates found in
126	<KOHA_ROOT>/koha-tmpl/intranet-tmpl/prog/en/ directory.
127
128	=item F<lang>-pref.po
129
130	Contains extracted text from english (en) preferences. They are found in files
131	located in <KOHA_ROOT>/koha-tmpl/intranet-tmpl/prog/en/admin/preferences
132	directory.
133
134	=back
135
136	=item translate [-p] update F<lang>
137
138	Update .po files in F<po> directory, named F<lang>-*.po. Without F<lang>, all
139	available languages are updated. With -p option, only preferences .po file is
140	updated.
141
142	=item translate [-p\|-f] install F<lang>	106	=item translate [-p\|-f] install F<lang>
143		107
144	Use .po files to translate the english version of templates and preferences files	108	Use .po files to translate the english version of templates and preferences files

Line 0 Link Here

(-)a/misc/translator/xgettext-installer (+143 lines)
		1	#!/usr/bin/perl
		2
		3	=head1 NAME
		4
		5	xgettext-installer - extract translatable strings from installer YAML files
		6
		7	=head1 SYNOPSIS
		8
		9	xgettext-installer [OPTION] [INPUTFILE]...
		10
		11	=head1 OPTIONS
		12
		13	=over
		14
		15	=item B<-f, --files-from=FILE>
		16
		17	get list of input files from FILE
		18
		19	=item B<-o, --output=FILE>
		20
		21	write output to the specified file
		22
		23	=item B<-h, --help>
		24
		25	display this help and exit
		26
		27	=back
		28
		29	=cut
		30
		31	use Modern::Perl;
		32
		33	use Getopt::Long;
		34	use Locale::PO;
		35	use Pod::Usage;
		36	use YAML::Syck qw(LoadFile);
		37
		38	$YAML::Syck::ImplicitTyping = 1;
		39
		40	my $output = 'messages.pot';
		41	my $files_from;
		42	my $help;
		43
		44	GetOptions(
		45	'output=s' => \$output,
		46	'files-from=s' => \$files_from,
		47	'help' => \$help,
		48	) or pod2usage(-verbose => 1, -exitval => 2);
		49
		50	if ($help) {
		51	pod2usage(-verbose => 1, -exitval => 0);
		52	}
		53
		54	my @files = @ARGV;
		55	if ($files_from) {
		56	open(my $fh, '<', $files_from) or die "Cannot open $files_from: $!";
		57	push @files, <$fh>;
		58	chomp @files;
		59	close $fh;
		60	}
		61
		62	my $pot = {
		63	'' => Locale::PO->new(
		64	-msgid => '',
65	-msgstr =>
66	"Project-Id-Version: Koha\n"
67	. "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
68	. "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\n"
69	. "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\n"
70	. "MIME-Version: 1.0\n"
71	. "Content-Type: text/plain; charset=UTF-8\n"
72	. "Content-Transfer-Encoding: 8bit\n"
73	),
74	};
75
76	for my $file (@files) {
77	my $yaml = LoadFile($file);
78	my @tables = @{ $yaml->{'tables'} };
79
80	my $tablec = 0;
81	for my $table (@tables) {
82	$tablec++;
83
84	my $table_name = ( keys %$table )[0];
85	my @translatable = @{ $table->{$table_name}->{translatable} };
86	my @rows = @{ $table->{$table_name}->{rows} };
87	my @multiline = @{ $table->{$table_name}->{'multiline'} };
88
89	my $rowc = 0;
90	for my $row (@rows) {
91	$rowc++;
92
93	for my $field (@translatable) {
94	if ( @multiline and grep { $_ eq $field } @multiline ) {
95	# multiline fields, only notices ATM
96	my $mulc;
97	foreach my $line ( @{ $row->{$field} } ) {
98	$mulc++;
99
100	# discard pure html, TT, empty
101	next if ( $line =~ /^(\s<.?>\s$\|^\s\[.?\]\s\|\s*)$/ );
102
103	# put placeholders
104	$line =~ s/(<<.?>>\|\[\%.?\%\]\|<.*?>)/\%s/g;
105
106	# discard non strings
107	next if ( $line =~ /^(\s\|%s\|-\|[[:punct:]]\|\(\|\))*$/ or length($line) < 2 );
108	if ( not $pot->{$line} ) {
109	my $msg = new Locale::PO(
110	-msgid => $line,
111	-msgstr => '',
112	-reference => "$file:$table_name:$tablec:row:$rowc:mul:$mulc"
113	);
114	$pot->{$line} = $msg;
115	}
116	}
117	} elsif (defined $row->{$field} && length($row->{$field}) > 1 && !$pot->{ $row->{$field} }) {
118	my $msg = new Locale::PO(
119	-msgid => $row->{$field},
120	-msgstr => '',
121	-reference => "$file:$table_name:$tablec:row:$rowc"
122	);
123	$pot->{ $row->{$field} } = $msg;
124	}
125	}
126	}
127	}
128
129	my $desccount = 0;
130	for my $description ( @{ $yaml->{'description'} } ) {
131	$desccount++;
132	if ( length($description) > 1 and not $pot->{$description} ) {
133	my $msg = new Locale::PO(
134	-msgid => $description,
135	-msgstr => '',
136	-reference => "$file:description:$desccount"
137	);
138	$pot->{$description} = $msg;
139	}
140	}
141	}
142
143	Locale::PO->save_file_fromhash($output, $pot);

Line 0 Link Here

(-)a/misc/translator/xgettext-pref (+134 lines)
		1	#!/usr/bin/perl
		2
		3	=head1 NAME
		4
		5	xgettext-pref - extract translatable strings from system preferences YAML files
		6
		7	=head1 SYNOPSIS
		8
		9	xgettext-pref [OPTION] [INPUTFILE]...
		10
		11	=head1 OPTIONS
		12
		13	=over
		14
		15	=item B<-f, --files-from=FILE>
		16
		17	get list of input files from FILE
		18
		19	=item B<-o, --output=FILE>
		20
		21	write output to the specified file
		22
		23	=item B<-h, --help>
		24
		25	display this help and exit
		26
		27	=back
		28
		29	=cut
		30
		31	use Modern::Perl;
		32
		33	use Getopt::Long;
		34	use Locale::PO;
		35	use Pod::Usage;
		36	use YAML::Syck qw(LoadFile);
		37
		38	$YAML::Syck::ImplicitTyping = 1;
		39
		40	my $output = 'messages.pot';
		41	my $files_from;
		42	my $help;
		43
		44	GetOptions(
		45	'output=s' => \$output,
		46	'files-from=s' => \$files_from,
		47	'help' => \$help,
		48	) or pod2usage(-verbose => 1, -exitval => 2);
		49
		50	if ($help) {
		51	pod2usage(-verbose => 1, -exitval => 0);
		52	}
		53
		54	my @files = @ARGV;
		55	if ($files_from) {
		56	open(my $fh, '<', $files_from) or die "Cannot open $files_from: $!";
		57	push @files, <$fh>;
		58	chomp @files;
		59	close $fh;
		60	}
		61
		62	my $pot = {
		63	'' => Locale::PO->new(
		64	-msgid => '',
65	-msgstr => "Project-Id-Version: Koha\n"
66	. "PO-Revision-Date: YEAR-MO-DA HO:MI +ZONE\n"
67	. "Last-Translator: FULL NAME <EMAIL\@ADDRESS>\n"
68	. "Language-Team: Koha Translate List <koha-translate\@lists.koha-community.org>\n"
69	. "MIME-Version: 1.0\n"
70	. "Content-Type: text/plain; charset=UTF-8\n"
71	. "Content-Transfer-Encoding: 8bit\n"
72	),
73	};
74
75	for my $file (@files) {
76	my $pref = LoadFile($file);
77	while ( my ($tab, $tab_content) = each %$pref ) {
78	add_po($file, undef, $tab);
79
80	if ( ref($tab_content) eq 'ARRAY' ) {
81	add_prefs( $file, $tab, $tab_content );
82	} else {
83	while ( my ($section, $sysprefs) = each %$tab_content ) {
84	my $context = "$tab > $section";
85	add_po($file, $tab, $section);
86	add_prefs( $file, $context, $sysprefs );
87	}
88	}
89	}
90	}
91
92	Locale::PO->save_file_fromhash($output, $pot);
93
94	sub add_prefs {
95	my ($file, $context, $prefs) = @_;
96
97	for my $pref (@$prefs) {
98	my $pref_name = '';
99	for my $element (@$pref) {
100	if ( ref($element) eq 'HASH' ) {
101	$pref_name = $element->{pref};
102	last;
103	}
104	}
105	for my $element (@$pref) {
106	if ( ref($element) eq 'HASH' ) {
107	while ( my ( $key, $value ) = each(%$element) ) {
108	next unless $key eq 'choices' or $key eq 'multiple';
109	next unless ref($value) eq 'HASH';
110	for my $ckey ( keys %$value ) {
111	add_po( $file, "$context > $pref_name", $value->{$ckey} );
112	}
113	}
114	}
115	elsif ($element) {
116	add_po( $file, "$context > $pref_name", $element );
117	}
118	}
119	}
120	}
121
122	sub add_po {
123	my ( $reference, $msgctxt, $msgid ) = @_;
124
125	return unless $msgid;
126
127	my $key = ($msgctxt // '') . ";$msgid";
128	$pot->{$key} = Locale::PO->new(
129	-reference => $reference,
130	-msgctxt => $msgctxt,
131	-msgid => $msgid,
132	-msgstr => '',
133	);
134	}

Line 0 Link Here

(-)a/misc/translator/xgettext-tt2 (+41 lines)
	1	#!/usr/bin/perl
	2
	3	use Modern::Perl;
	4
	5	my $xgettext = Locale::XGettext::TT2::Koha->newFromArgv(\@ARGV);
	6	$xgettext->setOption('plug_in', '');
	7	$xgettext->run;
	8	$xgettext->output;
	9
	10	package Locale::XGettext::TT2::Koha;
	11
	12	use parent 'Locale::XGettext::TT2';
	13
	14	sub defaultKeywords {
	15	return [
	16	't:1',
	17	'tx:1',
	18	'tn:1,2',
	19	'tnx:1,2',
	20	'txn:1,2',
	21	'tp:1c,2',
	22	'tpx:1c,2',
	23	'tnp:1c,2,3',
	24	'tnpx:1c,2,3',
	25	];
	26	}
	27
	28	sub defaultFlags {
	29	return [
	30	'tx:1:perl-brace-format',
	31	'tnx:1:perl-brace-format',
	32	'tnx:2:perl-brace-format',
	33	'txn:1:perl-brace-format',
	34	'txn:2:perl-brace-format',
	35	'tpx:2:perl-brace-format',
	36	'tnpx:2:perl-brace-format',
	37	'tnpx:3:perl-brace-format',
	38	],
	39	}
	40
	41	1;

Lines 1-109 Link Here

(-)a/t/LangInstaller.t (-109 lines)
1	use Modern::Perl;
2
3	use FindBin '$Bin';
4	use lib "$Bin/../misc/translator";
5
6	use Test::More tests => 39;
7	use File::Temp qw(tempdir);
8	use File::Slurp;
9	use Locale::PO;
10
11	use t::lib::Mocks;
12
13	use_ok('LangInstaller');
14
15	my $installer = LangInstaller->new();
16
17	my $tempdir = tempdir(CLEANUP => 0);
18	t::lib::Mocks::mock_config('intrahtdocs', "$Bin/LangInstaller/templates");
19	my @files = ('simple.tt');
20	$installer->extract_messages_from_templates($tempdir, 'intranet', @files);
21
22	my $tempfile = "$tempdir/koha-tmpl/intranet-tmpl/simple.tt";
23	ok(-e $tempfile, 'it has created a temporary file simple.tt');
24	SKIP: {
25	skip "simple.tt does not exist", 37 unless -e $tempfile;
26
27	my $output = read_file($tempfile);
28	my $expected_output = <<'EOF';
29	__('hello');
30	__x('hello {name}');
31	__n('item', 'items');
32	__nx('{count} item', '{count} items');
33	__p('context', 'hello');
34	__px('context', 'hello {name}');
35	__np('context', 'item', 'items');
36	__npx('context', '{count} item', '{count} items');
37	__npx('context', '{count} item', '{count} items');
38	__x('status is {status}');
39	__('active');
40	__('inactive');
41	__('Inside block');
42	EOF
43
44	is($output, $expected_output, "Output of extract_messages_from_templates is as expected");
45
46	my $xgettext_cmd = "xgettext -L Perl --from-code=UTF-8 "
47	. "--package-name=Koha --package-version='' "
48	. "-k -k__ -k__x -k__n:1,2 -k__nx:1,2 -k__xn:1,2 -k__p:1c,2 "
49	. "-k__px:1c,2 -k__np:1c,2,3 -k__npx:1c,2,3 "
50	. "-o $tempdir/Koha.pot -D $tempdir koha-tmpl/intranet-tmpl/simple.tt";
51
52	system($xgettext_cmd);
53	my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");
54
55	my @expected = (
56	{
57	msgid => '"hello"',
58	},
59	{
60	msgid => '"hello {name}"',
61	},
62	{
63	msgid => '"item"',
64	msgid_plural => '"items"',
65	},
66	{
67	msgid => '"{count} item"',
68	msgid_plural => '"{count} items"',
69	},
70	{
71	msgid => '"hello"',
72	msgctxt => '"context"',
73	},
74	{
75	msgid => '"hello {name}"',
76	msgctxt => '"context"',
77	},
78	{
79	msgid => '"item"',
80	msgid_plural => '"items"',
81	msgctxt => '"context"',
82	},
83	{
84	msgid => '"{count} item"',
85	msgid_plural => '"{count} items"',
86	msgctxt => '"context"',
87	},
88	{
89	msgid => '"status is {status}"',
90	},
91	{
92	msgid => '"active"',
93	},
94	{
95	msgid => '"inactive"',
96	},
97	{
98	msgid => '"Inside block"',
99	},
100	);
101
102	for (my $i = 0; $i < @expected; $i++) {
103	for my $key (qw(msgid msgid_plural msgctxt)) {
104	my $expected = $expected[$i]->{$key};
105	my $expected_str = defined $expected ? $expected : 'not defined';
106	is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
107	}
108	}
109	}

Line 0 Link Here

(-)a/t/misc/translator/sample.pref (+14 lines)
	1	Section:
	2	Subsection:
	3	-
	4	- pref: SamplePref
	5	choices:
	6	on: Do
	7	off: Do not do
	8	- that thing
	9	-
	10	- pref: MultiplePref
	11	multiple:
	12	foo: Foo ツ
	13	bar: Bar
	14	baz: Baz

Line 0 Link Here

(-)a/t/misc/translator/sample.yml (+15 lines)
	1	description:
	2	- "Sample installer file"
	3
	4	tables:
	5	- table1:
	6	translatable: [ column1, column2 ]
	7	multiline: [ column2 ]
	8	rows:
	9	- column1: foo ツ
	10	column2:
	11	- bar
	12	- baz
	13	column3: qux
	14	column4:
	15	- quux

Line 0 Link Here

(-)a/t/misc/translator/xgettext-installer.t (+32 lines)
	1	#!/usr/bin/perl
	2
	3	use Modern::Perl;
	4
	5	use File::Slurp;
	6	use File::Temp qw(tempdir);
	7	use FindBin qw($Bin);
	8	use Locale::PO;
	9	use Test::More tests => 4;
	10
	11	my $tempdir = tempdir(CLEANUP => 1);
	12
	13	write_file("$tempdir/files", "$Bin/sample.yml");
	14
	15	my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-installer "
	16	. "-o $tempdir/Koha.pot -f $tempdir/files";
	17
	18	system($xgettext_cmd);
	19	my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");
	20
	21	my @expected = (
	22	{ msgid => '"Sample installer file"' },
	23	{ msgid => '"bar"' },
	24	{ msgid => '"baz"' },
	25	{ msgid => '"foo ツ"' },
	26	);
	27
	28	for (my $i = 0; $i < @expected; $i++) {
	29	my $expected = $expected[$i]->{msgid};
	30	my $expected_str = defined $expected ? $expected : 'not defined';
	31	is($pot->[$i + 1]->msgid, $expected, "$i: msgid is $expected_str");
	32	}

Line 0 Link Here

(-)a/t/misc/translator/xgettext-pref.t (+61 lines)
	1	#!/usr/bin/perl
	2
	3	use Modern::Perl;
	4
	5	use File::Slurp;
	6	use File::Temp qw(tempdir);
	7	use FindBin qw($Bin);
	8	use Locale::PO;
	9	use Test::More tests => 16;
	10
	11	my $tempdir = tempdir(CLEANUP => 1);
	12
	13	write_file("$tempdir/files", "$Bin/sample.pref");
	14
	15	my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-pref "
	16	. "-o $tempdir/Koha.pot -f $tempdir/files";
	17
	18	system($xgettext_cmd);
	19	my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");
	20
	21	my @expected = (
	22	{
	23	msgid => '"Section"',
	24	},
	25	{
	26	msgctxt => '"Section > Subsection > MultiplePref"',
	27	msgid => '"Bar"',
	28	},
	29	{
	30	msgctxt => '"Section > Subsection > MultiplePref"',
	31	msgid => '"Baz"',
	32	},
	33	{
	34	msgctxt => '"Section > Subsection > MultiplePref"',
	35	msgid => '"Foo ツ"',
	36	},
	37	{
	38	msgctxt => '"Section > Subsection > SamplePref"',
	39	msgid => '"Do"',
	40	},
	41	{
	42	msgctxt => '"Section > Subsection > SamplePref"',
	43	msgid => '"Do not do"',
	44	},
	45	{
	46	msgctxt => '"Section > Subsection > SamplePref"',
	47	msgid => '"that thing"',
	48	},
	49	{
	50	msgctxt => '"Section"',
	51	msgid => '"Subsection"',
	52	},
	53	);
	54
	55	for (my $i = 0; $i < @expected; $i++) {
	56	for my $key (qw(msgid msgctxt)) {
	57	my $expected = $expected[$i]->{$key};
	58	my $expected_str = defined $expected ? $expected : 'not defined';
	59	is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
	60	}
	61	}

Line 0 Link Here

(-)a/t/misc/translator/xgettext-tt2.t (+74 lines)
		1	#!/usr/bin/perl
		2
		3	use Modern::Perl;
		4
		5	use File::Slurp;
		6	use File::Temp qw(tempdir);
		7	use FindBin qw($Bin);
		8	use Locale::PO;
		9	use Test::More tests => 36;
		10
		11	my $tempdir = tempdir(CLEANUP => 1);
		12
		13	write_file("$tempdir/files", "$Bin/sample.tt");
		14
		15	my $xgettext_cmd = "$Bin/../../../misc/translator/xgettext-tt2 --from-code=UTF-8 "
		16	. "-o $tempdir/Koha.pot -f $tempdir/files";
		17
		18	system($xgettext_cmd);
		19	my $pot = Locale::PO->load_file_asarray("$tempdir/Koha.pot");
		20
		21	my @expected = (
		22	{
		23	msgid => '"hello ツ"',
		24	},
		25	{
		26	msgid => '"hello {name}"',
		27	},
		28	{
		29	msgid => '"item"',
		30	msgid_plural => '"items"',
		31	},
		32	{
		33	msgid => '"{count} item"',
		34	msgid_plural => '"{count} items"',
		35	},
		36	{
		37	msgid => '"hello"',
		38	msgctxt => '"context"',
		39	},
		40	{
		41	msgid => '"hello {name}"',
		42	msgctxt => '"context"',
		43	},
		44	{
		45	msgid => '"item"',
		46	msgid_plural => '"items"',
		47	msgctxt => '"context"',
		48	},
		49	{
		50	msgid => '"{count} item"',
		51	msgid_plural => '"{count} items"',
		52	msgctxt => '"context"',
		53	},
		54	{
		55	msgid => '"status is {status}"',
		56	},
		57	{
		58	msgid => '"active"',
		59	},
		60	{
		61	msgid => '"inactive"',
		62	},
		63	{
		64	msgid => '"Inside block"',
65	},
66	);
67
68	for (my $i = 0; $i < @expected; $i++) {
69	for my $key (qw(msgid msgid_plural msgctxt)) {
70	my $expected = $expected[$i]->{$key};
71	my $expected_str = defined $expected ? $expected : 'not defined';
72	is($pot->[$i + 1]->$key, $expected, "$i: $key is $expected_str");
73	}
74	}