apache / apache/beam

[Failing Test]: testE2EBigtableWriteWith[...]Failures flaky

Open
#32,047 1 comment 0 reactions 0 assignees View on GitHub
awaiting triage bigtable bug failing test flake io java P2 pinned tests
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

### What happened?

These error handler tests have long been flaky. For example, in the last 2 weeks, PostCommit Java Dataflow V2 failed 10 times, 6 due to one test failed in these five:

testE2EBigtableWriteWithInvalidColumnFamilyFailures

testE2EBigtableWriteWithEmptyMutationFailures

testE2EBigtableWriteWithEmptyRowFailures

testE2EBigtableWriteWithInvalidTimestampFailures

testE2EBigtableWriteWithOversizedQualifierFailures

Example error:

```
java.lang.RuntimeException: org.apache.beam.sdk.util.UserCodeException: java.lang.AssertionError: Write to error Sink/Combine/Flatten.PCollections.out:
Expected: <2L>
but: was <1L>
at org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
at org.apache.beam.sdk.testing.PAssert$DefaultConcludeFn$DoFnInvoker.invokeProcessElement(Unknown Source)
...
Caused by: java.lang.AssertionError: Write to error Sink/Combine/Flatten.PCollections.out:
Expected: <2L>
but: was <1L>
at org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:176)
at org.apache.beam.sdk.testing.PAssert.thatSingleton(PAssert.java:499)
at org.apache.beam.sdk.testing.PAssert.thatSingleton(PAssert.java:491)
at org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT.failureTest(BigtableWriteIT.java:341)
at org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT.testE2EBigtableWriteWithInvalidColumnFamilyFailures(BigtableWriteIT.java:164)
```

it appears to be related to how elements are bundled, as Dataflow v1 / v2 / direct runner has different flaky rate (Dataflow v2 test fails most frequently)

### Issue Failure

Failure: Test is flaky

### Issue Priority

Priority: 2 (backlog / disabled test but we think the product is healthy)

### Issue Components

- [ ] Component: Python SDK
- [X] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [X] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Infrastructure
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.