[Bug]: Cross-language pipeline options are not picked up in Java DoFns
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
### What happened?
I noticed this when testing with Managed BigQueryIO in Python SDK:
```python
options = PipelineOptions([
"--project=google.com:clouddfe",
"--region=us-central1",
"--temp_location=gs://ahmedabualsaud-wordcount/tmp",
])
with beam.Pipeline(options=options) as p:
(p
| beam.Create([beam.Row(int=999)])
| beam.managed.Write("bigquery",
config={"table": "google.com:clouddfe.ahmedabualsaud.test_table"},
expansion_service="localhost:12345"
))
```
I would expect these pipeline options to be picked up on Java's side. With some logging, I see the Java SDK recognizing the options at expand time in PTransforms (i.e. expand()), but not at runtime in DoFns (i.e. @ProcessElement).
### Issue Priority
Priority: 2 (default / most bugs should be filed as P2)
### Issue Components
- [ ] Component: Python SDK
- [X] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Infrastructure
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
Contributor guide
Assessment
This issue has not been assessed yet.