[Feature Request]: Optimize dependency handling of the transform service
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
### What would you like to happen?
In https://github.com/apache/beam/pull/26023, we are adding a Transform Service that uses Docker Compose.
In the future, we could use this to significantly improve dependency handling related to cross-language transforms. For example,
(1) Offer artifact types other than files through the transform service.
(2) More fine grained dependency handling and removing dependency on large expansion service jars.
(3) Getting rid of large expansion service jars.
### Issue Priority
Priority: 3 (nice-to-have improvement)
### Issue Components
- [ ] Component: Python SDK
- [ ] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
Contributor guide
Assessment
This issue has not been assessed yet.