apache / apache/beam

The PostCommit PortableJar Spark job is flaky

Open
#37,653 5 comments 0 reactions 0 assignees View on GitHub
bug flaky_test P1 workflow_id: 69536387
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

The PostCommit PortableJar Spark is failing over 50% of the time.
Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_PortableJar_Spark.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs.
See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=11&var-Workflow=PostCommit%20PortableJar%20Spark

Contributor guide

Open the contributing guide

Research direction

Start by reviewing failed runs for the PostCommit PortableJar Spark workflow linked in the issue, then compare the failures with the Grafana status statistics. Done means identifying the cause of the flakiness and making the workflow reliably pass; the payload does not name a source file or test.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, spark
Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.