Support External Environment For Java SDK Harness
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
As mentioned in this [thread](https://lists.apache.org/x/thread.html/r3cf56464c157da840f46e777c1b3f307f65ec2cf6b2278728f2cd1e1@%3Cuser.beam.apache.org%3E) the Java SDK harness only supports environments docker and embedded for the Java SDK harness.
It would be nice if the Java SDK also supported external environments similar to what the Python SDK harness does.
The use case would be running in Kubernetes. On Kubernetes I think its better to run the SDK harness containers as side cars of the taskmanager pods rather than relying on docker in docker. Docker in docker isn't great from a security standpoint because it requires privileged containers. It also makes it harder to debug and operate on Kubernetes.
This was also mentioned in this thread on the developer mailing list; [thread](https://lists.apache.org/thread.html/r43fbff58c0d11b05a74617b175ed2d0565b9e65717e92f1dd908f4fa%40%3Cdev.beam.apache.org%3E)
Imported from Jira [BEAM-12814](https://issues.apache.org/jira/browse/BEAM-12814). Original Jira may contain additional context.
Reported by: jeremy@lewi.us.
Contributor guide
Assessment
This issue has not been assessed yet.