Bug 39324 - [OMNIBUS] All QA tests should pass
Summary: [OMNIBUS] All QA tests should pass
Status: RESOLVED FIXED
Alias: None
Product: Koha
Classification: Unclassified
Component: Architecture, internals, and plumbing (show other bugs)
Version: unspecified
Hardware: All All
: P5 - low enhancement
Assignee: Jonathan Druart
QA Contact: Testopia
URL:
Keywords:
Depends on: 39319 39325 39365 39367 39835 39834
Blocks:
  Show dependency treegraph
 
Reported: 2025-03-13 14:41 UTC by Jonathan Druart
Modified: 2025-06-05 13:15 UTC (History)
11 users (show)

See Also:
GIT URL:
Change sponsored?: ---
Patch complexity: ---
Documentation contact:
Documentation submission:
Text to go in the release notes:
Version(s) released in:
Circulation function:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jonathan Druart 2025-03-13 14:41:48 UTC
Currently we have the QA script (qa-test-tools) running the tests before and after the patches we are testing.

Then we compare the results and raise errors in case of new introduced errors.

It is causing several problems:
1. Bad detection of deleted/moved files
2. False positives and some errors we don't catch
3. It is slow to run, especially because of the git manipulation (switch of branches)

Ideally we need the tests to pass on the whole codebase, so we just need to run the tests on the file modified by the patchset.

This is an omnibus bug in order to track the different steps we need to make the tests pass on the whole codebase, before being able to adjust the QA script.

See also https://gitlab.com/koha-community/qa-test-tools/-/issues/93