apache / apache/beam

BigQueryWriteClient in DatasetServiceImpl is not closed, which causes "ManagedChannel allocation site" exceptions

Open
#20,970 4 comments 1 reaction 1 assignee Claimed by @reuvenlax View on GitHub
bug gcp io java P2
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

[BigQueryWriteClient](https://github.com/apache/beam/blob/v2.29.0/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java#L461) in DatasetServiceImpl (added at [https://github.com/apache/beam/pull/14309)](https://github.com/apache/beam/pull/14309)) is not closed.  This causes the error logs  in gRPC orphan channel clean up. See "bigquery_grpc.log" in attachments which is extracted from GCP Dataflow. I don't think this issue affect pipeline runs except the error logs, but could you take a look at that?

A similar issue is reported for `CloudBigtableIO` at [https://github.com/googleapis/java-bigtable-hbase/issues/2658](https://github.com/googleapis/java-bigtable-hbase/issues/2658)

 

Imported from Jira [BEAM-12356](https://issues.apache.org/jira/browse/BEAM-12356). Original Jira may contain additional context.
Reported by: baeminbo.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.