apache / apache/beam

[Feature Request]: Handle failed inserts in Storage API sink

Open
#23,628 1 comment 0 reactions 0 assignees View on GitHub
gcp io java new feature P2
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

### What would you like to happen?

The Storage API BigQuery sink already handles rows that do not conform to schema and forwards them to the failed-rows PCollection. We should handle the remaining cases - rows that are too large, and rows that don't conform to any other BigQuery constraints.

### Issue Priority

Priority: 2

### Issue Component

Component: io-java-gcp

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.