apache / apache/beam

Add tests to ensure BQIO Export (Python SDK) Works as intended.

Open
#26,358 0 comments 0 reactions 0 assignees View on GitHub
awaiting triage bug io P3 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

### What happened?

https://github.com/apache/beam/pull/26270 introduced a regression that was caught manually- that is, when using ReadFromBigQuery IO (Python SDK) Export mode, files are exported to GCS, read from GCS, then deleted from GCS.

We should ensure that the files are actually deleted from GCS.

### Issue Priority

Priority: 3 (minor)

### Issue Components

- [X] Component: Python SDK
- [ ] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [X] Component: IO connector
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.