Skip to content

Reduce Test Runtime

Marcel Koch requested to merge feature/ci-quick-test into master

IMO the running the tests takes to long, currently (with the prebuild pdelab docker image) it takes about 40min. My first idea to reduce the runtime, is to run only a small portion of the tests, using the quick label. This cuts down the runtime to about 12min, which is an improvement, but still not great. My target would be under 5min, but this seems impossible, since the cmake generation takes about that much.

Current time sinks:

  • cmake generation before installing python packages
  • installing the python packages
  • generating all test targets
  • building the tests

I'm not sure how to reduce any of those (except for building even less tests).

The tests I've chosen to add the quick label in such a way that (hopefully) if these tests pass all other tests should pass as well. Since I'm not so familiar with the sumfact tests, my selection may be not ideal.

Edited by Marcel Koch

Merge request reports