Threads leak between test runs

It seems like currently our test classes do not properly cleanup started threads / executors after execution.
This seems to not have caused any problems / flakyness yet, but is a waste of resources and therefore could potentially slow down the execution on CI/CD.

See [this comment](https://github.com/elastic/apm-agent-java/pull/2900#discussion_r1039811803) for details.