apache / apache/beam

[Failing Test]: beam_PreCommit_Java_GCP_IO_Direct high possibility timeout

Open
#25,207 4 comments 0 reactions 0 assignees View on GitHub
bug failing test flake gcp io java P2 tests
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

### What happened?

When not timing out, the test takes ~30-40 min; or it timing out after 2 hour: https://ci-beam.apache.org/job/beam_PreCommit_Java_GCP_IO_Direct_Cron/

From the log, in the cases of timeout, the task gets stuck early:
```
17:53:23 > Task :sdks:java:io:google-cloud-platform:expansion-service:distZip
17:53:48 > Task :sdks:java:io:google-cloud-platform:test
17:53:53 > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowJar
17:54:03 > Task :sdks:java:io:google-cloud-platform:expansion-service:startShadowScripts
17:54:03 > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistTar
17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistZip
17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:assemble
17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies
17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies
17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:check
17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:build
19:52:33 Build timed out (after 120 minutes). Marking the build as aborted.
```
Particularly, `:sdks:java:io:google-cloud-platform:test` is executing but `:sdks:java:io:google-cloud-platform:integrationTest` not yet started. Likely some unit test having race conditions.

### Issue Failure

Failure: Test is flaky

### Issue Priority

Priority: 2 (backlog / disabled test but we think the product is healthy)

### Issue Components

- [ ] Component: Python SDK
- [x] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner

Contributor guide

Open the contributing guide

Research direction

Start with the ci-beam.apache.org beam_PreCommit_Java_GCP_IO_Direct_Cron job and compare logs where :sdks:java:io:google-cloud-platform:test stalls before integrationTest starts. Inspect the Java Google Cloud Platform test task and identify the flaky unit-test behavior; done means the job completes reliably within its timeout.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, java
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.