apache / apache/beam

[Feature Request]: Predictable job names for tests running on Dataflow

Open
#27,814 1 comment 0 reactions 0 assignees View on GitHub
awaiting triage dataflow new feature P2 stale
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

### What would you like to happen?

When debugging failing tests, it can be difficult to go back and look at worker logs of successful tests, since the job ids aren't surfaced by Jenkins. I understand we are hoping to move over to Github Actions soon but it is not expected that this will resolve this issue. Therefore, being able to set Dataflow job ids in a predictable way for each test (e.g. testname_datetime) would allow us to more easily and directly compare past runs.

### Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

### Issue Components

- [ ] Component: Python SDK
- [ ] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [X] Component: Google Cloud Dataflow Runner

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.