Possible docker cache layer conflicts

### Context

While debugging tests locally I encountered a strange issue where my version of the test being ran was not outputting the expected output. This was accompanied by inconsistent docker build times. So far this has only been encountered locally.

Experienced behavior
Test run 1:
- Prints out test message to console
Test run 2:
- Nothing printed out
Test run 3:
- Prints out test message to console

### Problem or idea

We should try to recreate this issue deliberately so we can determine how / what we need to fix.

### Solution or next step

Recreate the issue and report under this issue.