Skip to content

OPALX OPALX

Regression Tests

Open the results: every published run with its unit tests, regression checks and plots of the current against the reference curves.

How a run gets here

  1. Run the tests. On the test machine, tools/run_suite.py runs ctest and every regression simulation of regression-tests-x with one OPALX build.
  2. Pack the results. tools/pack_run.py compares each checked metric with its reference .stat file and writes two files per run: run.json (verdicts, unit tests, log tails) and series.json.gz (every plotted point).
  3. Upload. tools/publish_run.sh pushes the run directory to data/runs/<branch>/<arch>/<run_id>/ on main. It adds a new directory and edits nothing else.
  4. Deploy. Each push to main starts the Pages build. It renders this page, copies the viewer and the run data, writes index.json (the list of all runs) and publishes everything on the gitea-pages branch.

tools/regtest.sh does steps 1 to 3 with one command. The browser draws every plot from the two files of a run; there are no image files. Runs imported from the old results website have no plot data and show their verdicts only.