Beam SQL should clean up resources upon termination of the pipeline
Open
dsl
new feature
P4
sql
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Currently `PubsubIO.read().fromTopic(...)` always creates a subscription that will never be deleted. Beam doesn't have an adequate model for cleanup tasks, but relies on external orchestration to clean up such things. Beam SQL can do this for LIMIT-bounded queries that actually do terminate.
Imported from Jira [BEAM-4688](https://issues.apache.org/jira/browse/BEAM-4688). Original Jira may contain additional context.
Reported by: kenn.
Contributor guide
Assessment
This issue has not been assessed yet.