Bug 33168

The historty.txt file is missing. Not sure why, but it is. In an older version of Koha, the file is there. In the current install it's just missing. Haven't gotten around to checking the Virtual Machine I was testing, before our current install. It may just be an issue with our install?

I have checked in master on ktd and there the about page works as expected. Could this be a packaging problem? If he file was not copied into the right place in the file structure, that could explain the issue.

The file is definitely present in the dev environment:
/kohadevbox/koha/docs/history.txt

(In reply to Katrin Fischer from comment #2)
> I have checked in master on ktd and there the about page works as expected.
> Could this be a packaging problem? If he file was not copied into the right
> place in the file structure, that could explain the issue.
> 
> The file is definitely present in the dev environment:
> /kohadevbox/koha/docs/history.txt

It definitely works on master in the KTD but all our partners are having this issue. I will look into it further. Thanks!

(In reply to Laura Escamilla from comment #0)
> When viewing the timeline tab on the "About Koha" page, the error: "Could
> not read the history.txt file. Please make sure <docdir> is correctly
> defined in koha-conf.xml." shows up.

hi Laura
this indicates that you seem to be missing a <docdir> definition

in a koha installed with a debian package, the following line should exist in your /etc/koha/sites/mykoha1/koha-conf.xml

  <docdir>/usr/share/doc/koha-common</docdir>


fyi: the history file should exist at /usr/share/doc/koha-common/history.txt

Hi Mason, 

it looks like this is not a singular/one installation issue. Our package installations of 22.11 are missing the file as well. It looks like a general issue with the package installations.

(In reply to Katrin Fischer from comment #5)
> Hi Mason, 
> 
> it looks like this is not a singular/one installation issue. Our package
> installations of 22.11 are missing the file as well. It looks like a general
> issue with the package installations.

hmm, the file exists in 22.11.03 package

----------

# apt install  koha-common

# apt policy koha-common
koha-common:
  Installed: 22.11.03-1
  Candidate: 22.11.03-1
  Version table:
 *** 22.11.03-1 500
        500 http://debian.koha-community.org/koha 22.11/main amd64 Packages
        100 /var/lib/dpkg/status

# dpkg -L   koha-common | grep history.txt
/usr/share/doc/koha-common/history.txt

# ls -l /usr/share/doc/koha-common/history.txt
-rw-r--r-- 1 root root 113207 Mar  1 01:54 /usr/share/doc/koha-common/history.txt

(In reply to Laura Escamilla from comment #0)
> When viewing the timeline tab on the "About Koha" page, the error: "Could
> not read the history.txt file. Please make sure <docdir> is correctly
> defined in koha-conf.xml." shows up.

Can we get information on what version of Koha this is happening?

Happens on our freshly packaged 22.11.03

(In reply to Katrin Fischer from comment #8)
> Happens on our freshly packaged 22.11.03

I'm going to set the version to 22.11 as 22.05 is fine and master ktd is OK.

I'm a bit behind these days but I should be looking at 22.11 Deb package installs in the near future...

We have <docdir>/usr/share/doc/koha-common</docdir> and history.txt doesn't exist.

(In reply to David Cook from comment #9)
> (In reply to Katrin Fischer from comment #8)
> > Happens on our freshly packaged 22.11.03
> 
> I'm going to set the version to 22.11 as 22.05 is fine and master ktd is OK.

I believe it's a packages thing because the file is not ending up where it should be, so it's not being copied/installed into the right spot.

(In reply to Katrin Fischer from comment #12)
> (In reply to David Cook from comment #9)
> > (In reply to Katrin Fischer from comment #8)
> > > Happens on our freshly packaged 22.11.03
> > 
> > I'm going to set the version to 22.11 as 22.05 is fine and master ktd is OK.
> 
> I believe it's a packages thing because the file is not ending up where it
> should be, so it's not being copied/installed into the right spot.

whats the output of?

# dpkg -L   koha-common | grep history.txt

Katrin: Is this a vanilla Debian package or is this one that you packaged?

I'm running a vanilla 22.05 and I see the history.txt, but I've looked again at my custom 21.11 and I do *not* see the history.txt.

Now I would've sworn that my 21.11 instances had a history.txt before, but looking today it is certainly gone. (However, I still see teams.yaml and contributors.yaml in /usr/share/doc/koha-common...)

# dpkg -l koha-common
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name           Version      Architecture Description
+++-==============-============-============-===============================================
ii  koha-common    22.05.08-2   all          integrated (physical) library management system

# dpkg -L   koha-common | grep "history.txt"
/usr/share/doc/koha-common/history.txt

-----------------------------------------------------

# dpkg -l koha-common
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name           Version                                  Architecture Description
+++-==============-========================================-============-===============================================
ii  koha-common    22.12.00-9~git+20230228053212.66e9bc71-1 all          integrated (physical) library management system

# dpkg -L   koha-common | grep "history.t

--------------------------------------------------

Checking more custom versions...

I have it in custom 20.11 but I do not have it in custom 21.11...

Interestingly my custom 21.11 had /usr/share/doc/koha-common/history.txt back in March 2022 but not in March 2023...

Not noticing anything obvious in the git repo that would've caused a change...

I think I may have made some build machine changes during that time so maybe that's related...

We built our own packages, although we are still very close to standard Koha. But Laura initially reported this, so it might be interesting to check with her too.

If I make a tarball from custom 21.11, I see docs/history.txt is in there...

But when I build from that same branch, the history.txt file is not in the .deb package. I can confirm that using 'dpkg -c' on the .deb file. 

--

It looks like it's being installed by dh_auto_install into the '/debian/tmp' build directory... 

Installing /home/koha/build/koha-21.11.XX-XXXX+20230320095638.5d5cedcd/debian/tmp/usr/share/koha/doc/teams.yaml
Installing /home/koha/build/koha-21.11.XX-XXXX+20230320095638.5d5cedcd/debian/tmp/usr/share/koha/doc/contributors.yaml
Installing /home/koha/build/koha-21.11.XX-XXXX+20230320095638.5d5cedcd/debian/tmp/usr/share/koha/doc/history.txt

However in debian/rules, we nuke /usr/share/koha/doc since we don't need it in /usr/share/koha... so that's irrelevant. Just shows that it does exist at that point in time...

--

I don't know. It's so weird that teams.yaml and contributors.yaml get included but history.txt does not.

(In reply to David Cook from comment #15)
> ii  koha-common    22.12.00-9~git+20230228053212.66e9bc71-1 all         
> integrated (physical) library management system
> 
> # dpkg -L   koha-common | grep "history.t
> 
> --------------------------------------------------

seems to be working ok on the latest master/dev branch

root@deb12:~# rm /usr/share/doc/koha-common/history.txt

root@deb12:~# apt install koha-common 
Unpacking koha-common (22.12.00-14~git+20230321055412.0fb86ccd-1) over (22.12.00-13~git+20230318103210.afdc1690-1) ...

root@deb12:~# ls -l  /usr/share/doc/koha-common/history.txt
-rw-r--r-- 1 root root 113207 Mar 21 06:00 /usr/share/doc/koha-common/history.txt

(In reply to Mason James from comment #20)
> (In reply to David Cook from comment #15)
> > ii  koha-common    22.12.00-9~git+20230228053212.66e9bc71-1 all         
> > integrated (physical) library management system
> > 
> > # dpkg -L   koha-common | grep "history.t
> > 
> > --------------------------------------------------
> 
> seems to be working ok on the latest master/dev branch

hmm, i think ive traced the problem to using deb9 vs deb10 pbuilder versions, (wtf)

(In reply to Mason James from comment #21)
> hmm, i think ive traced the problem to using deb9 vs deb10 pbuilder
> versions, (wtf)

Yeah, I think the problem surfaced when I switched from building on deb9 Stretch to deb11 Bullseye. 

I'm not using pbuilder so I imagine it's a lower level component causing the problem.

I'm wondering if "history.txt" is a magic word to newer versions of debuild (or another component), and if the solution is to just rename the file. 

Apparently dh_installchangelogs looks for history.txt...

Ahhhhhh guess what file is installed as /usr/share/doc/koha-common/changelog.gz? Our old friend history.txt!

"In non-native packages, dh_installchangelogs will first look for changelog files installed by the upstream build system into usr/share/doc/package (of the package build directory) and rename the most likely candidate (if any) to usr/share/doc/package/changelog."

https://manpages.debian.org/testing/debhelper/dh_installchangelogs.1.en.html

Looking back at 20.11, it looks like /usr/share/doc/koha-common/changelog.gz and /usr/share/doc/koha-common/history.txt are the same (except changelog.gz is obviously compressed)

(In reply to David Cook from comment #23)
> Looking back at 20.11, it looks like /usr/share/doc/koha-common/changelog.gz
> and /usr/share/doc/koha-common/history.txt are the same (except changelog.gz
> is obviously compressed)

The stretch version of dh_installchangelogs doesn't say anything about renaming: 
https://manpages.debian.org/stretch/debhelper/dh_installchangelogs.1.en.html

But the docs change for deb10 Buster: https://manpages.debian.org/buster/debhelper/dh_installchangelogs.1.en.html

Of course, I might be wrong. The documentation may have been updated while the behaviour stayed the same. Even in "stretch", there is a "-k" option for keeping the original name of the upstream changelog...

Ok if we compare different versions of dh_installchangelogs (thank you open source), we can see that the rename didn't happen back in the Stretch version:

https://github.com/Debian/debhelper/blob/debian/10.2.5/dh_installchangelogs

https://github.com/Debian/debhelper/blob/master/dh_installchangelogs

Looks like the change was introduced in debian 11.3 I think:
https://github.com/Debian/debhelper/commit/406bd37eb4692e172fbf6c3c390cb4f50d8eaae9

What a nice little breaking change hehe

So I reckon changing from history.txt to something else and then updating Koha to look for a different filename is the way to go.

However, we'd lose the current incarnation of changelog.gz in the process. 

That said, typically changelog.gz  contains the contents of the Debian package changelog anyway, and we already have that via changelog.Debian.gz, so I think it's all good.

Hmm I bet a number of the release tools look for history.txt. Maybe renaming is actually going to be more work...

I'm going to try out some packaging options...

First up:

override_dh_installchangelogs:
    dh_installchangelogs --exclude=history.txt

As predicted, we regain /usr/share/doc/koha-common/history.txt at the expense of /usr/share/doc/koha-common/changelog.gz

I think that's fine. 

I've noticed a number of packages that have "changelog.Debian.gz" but not "changelog.gz" or their changelog.gz is the same as "changelog.Debian.gz".

Created attachment 148497 [details] [review]
Bug 33168: Prevent debhelper from renaming history.txt to changelog

This change prevents debhelper from renaming history.txt to changelog,
since that renaming was breaking the Timeline feature in Koha.

Another option would've been to rename history.txt to something else
but that filename is already embedded in Koha and the Koha release
tools, so this seems the safer option.

Test plan:
0. Apply patch
1. Build Debian package
2. Confirm that /usr/share/doc/koha-common/history.txt is created
and /usr/share/doc/koha-common/changelog.gz is not created

In terms of "Version" affected, I suppose there is no harm in backporting this one...

Created attachment 148501 [details] [review]
Bug 33168: Prevent debhelper from renaming history.txt to changelog

This change prevents debhelper from renaming history.txt to changelog,
since that renaming was breaking the Timeline feature in Koha.

Another option would've been to rename history.txt to something else
but that filename is already embedded in Koha and the Koha release
tools, so this seems the safer option.

Test plan:
0. Apply patch
1. Build Debian package
2. Confirm that /usr/share/doc/koha-common/history.txt is created
and /usr/share/doc/koha-common/changelog.gz is not created

Signed-off-by: Mason James <mtj@kohaaloha.com>

> Signed-off-by: Mason James <mtj@kohaaloha.com>

tested as working on deb10

It looks like this required quite a bit of detectice work - thanks a lot!

(In reply to Katrin Fischer from comment #34)
> It looks like this required quite a bit of detectice work - thanks a lot!

A hunch and some lucky searching heh

Since Mason and I have already worked on this one, how do we move this along through QA?

1. Build Debian package

What's the easiest for that steps (in March 2023)?

(In reply to Jonathan Druart from comment #36)
> 1. Build Debian package
> 
> What's the easiest for that steps (in March 2023)?

hi Jonathan

try this wiki page, its been updated recently
 https://wiki.koha-community.org/wiki/Building_Debian_Packages_-_The_Easy_Way


update us, if you have any problems :)

Created attachment 148632 [details] [review]
Bug 33168: Prevent debhelper from renaming history.txt to changelog

This change prevents debhelper from renaming history.txt to changelog,
since that renaming was breaking the Timeline feature in Koha.

Another option would've been to rename history.txt to something else
but that filename is already embedded in Koha and the Koha release
tools, so this seems the safer option.

Test plan:
0. Apply patch
1. Build Debian package
2. Confirm that /usr/share/doc/koha-common/history.txt is created
and /usr/share/doc/koha-common/changelog.gz is not created

Signed-off-by: Mason James <mtj@kohaaloha.com>

Signed-off-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl>

In full trust :)

And covered by what I found here:

The upstream changelog is automatically found by the dh_installchangelogs using the case insensitive match of its file name to changelog, changes, changelog.txt, changes.txt, history, history.txt, or changelog.md and searched in the ./ doc/ or docs/ directories.

Pushed to master for 23.05.

Nice work everyone, thanks!

Created attachment 149038 [details] [review]
Bug 33168: swap spaces for tabs [follow-up]

Created attachment 149055 [details] [review]
Bug 33168: (follow-up) Swap spaces for tabs

Signed-off-by: David Nind <david@davidnind.com>

I tested the follow-up patch as follows using KTD:

1. Open debian/rules in a text editor with tabs and spaces displayed.
2. Note that on lines 51 and 52 that spaces are used instead of tabs. 
3. Apply the follow-up patch only (the main patch is already in master).
4. Note that the spaces in step 2 are now tabs.

I hope this is sufficient.

I also amended the commit message to follow the title conventions for follow-up patches.

Note: I also noticed that for lines 43 and 44 that spaces are used after the first tab - do these need to be fixed as well?

(In reply to David Nind from comment #43)
> Note: I also noticed that for lines 43 and 44 that spaces are used after the
> first tab - do these need to be fixed as well?

hi David
thanks for the sign-off

lines 43 and 44 are OK :)

(In reply to David Nind from comment #42)
> Created attachment 149055 [details] [review] [review]
> Bug 33168: (follow-up) Swap spaces for tabs
> 
> Signed-off-by: David Nind <david@davidnind.com>

Pushed to master for 23.05.00.

Nice work everyone!

Pushed to stable for 22.11.x

Backported to 22.05.x for upcoming 22.05.12

(In reply to Lucas Gass from comment #47)
> Backported to 22.05.x for upcoming 22.05.12

can we get this backported to 21.11 and 21.05 please

applied to 21.11.x for 21.11.20