Streaming - File name and Post processing file movement
Open
gcp
io
java
P3
wish
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
E.g., while streaming files from GCS to BigQuery we usually provide wild card to match file name. Wish to get full file name at the time of processing (simple use case: to log which exact file is being processed).
Also once processed file to be moved to different folder within same bucket / different bucket automatically.
Imported from Jira [BEAM-11186](https://issues.apache.org/jira/browse/BEAM-11186). Original Jira may contain additional context.
Reported by: aravindh.venkatesh.
Contributor guide
Assessment
This issue has not been assessed yet.