
Regression Tests¶
Open the results: every published run with its unit tests, regression checks and plots of the current against the reference curves.
How a run gets here¶
- Run the tests. On the test machine,
tools/run_suite.pyrunsctestand every regression simulation of regression-tests-x with one OPALX build. - Pack the results.
tools/pack_run.pycompares each checked metric with its reference.statfile and writes two files per run:run.json(verdicts, unit tests, log tails) andseries.json.gz(every plotted point). - Upload.
tools/publish_run.shpushes the run directory todata/runs/<branch>/<arch>/<run_id>/onmain. It adds a new directory and edits nothing else. - Deploy. Each push to
mainstarts the Pages build. It renders this page, copies the viewer and the run data, writesindex.json(the list of all runs) and publishes everything on thegitea-pagesbranch.
tools/regtest.sh does steps 1 to 3 with one command. The browser draws every plot from the
two files of a run; there are no image files.
Runs imported from the old results website have no plot data and show their verdicts only.