Pytest Json Report Viewer.

You run Pytest on many github action matrix element.

You want a breakdown on the elements that take the most time.

You use pytest with --duration but it's still hard to distinguish what is slow, especially with parametrized test.

Fear not, this is for you. This will give you a treemap breakdown of test durations, and you can choose how to breakdown the levels, for example you can aggregate time for each tests, regardless of GitHub action matrix element. Or decide to look only at parametrized tests.

Here is a screen shot example of napari test suite time breakdown, default view:

Removing the file in which the test are defined, summing across all 11 matrix element of github action, and adding a breakdown per item in @pytest.markparametrize:

configure GH Action to get artifacts:

Dependencies:

• add pytest-json-report to your test suite.

Tox:

If you are using tox in GHA add:

--json-report --json-report-file={toxinidir}/report-{envname}.json

Non TOX:

TODO

upload artifacts:

After running the test:

- uses: actions/upload-artifact@v3
  with:
    name: upload pytest timing reports as json
    path: |
      ./report-*.json

You will be able to download artifacts from the test summary "artifact download" section.