apache / apache/texera

Large binary writes can hang after a background upload failure

Open
#8,259 1 comment 0 reactions 1 assignee Claimed by @carloea2 View on GitHub
Dominant language
Scala
Stars
314
Forks
187
Avg merge
2d 8h
Merged PRs (30d)
209

Description

### Feature Summary

When the background S3 upload fails while `LargeBinaryOutputStream.write` is filling its bounded queue, the upload worker exits but the producer keeps waiting for queue capacity. The write call can hang forever. Closing the stream can hang for the same reason while enqueueing its EOF marker.

Before: an upload failure with a full queue leaves write and close blocked.

Expected: write and close stop waiting and report the recorded upload failure.

Reproduction evidence:

Version and commit evidence:

### Proposed Solution or Design

Expected: write and close stop waiting and report the recorded upload failure.

### Affected Area

Storage / Metadata

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.