apache / apache/beam

Add option to mount a directory inside SDK harness containers

Open
#19,240 3 comments 1 reaction 0 assignees View on GitHub
core flink fn-execution java new feature P3 portability runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

While experimenting with the Python SDK locally, I found it inconvenient that I can't mount a host directory to the Docker containers, i.e. the input must already be in the container and the results of a Write remain inside the container. For local testing, users may want to mount a host directory.

Since BEAM-5288 the `Environment` carries explicit environment information, we could a) add volume args to the `DockerPayload`, or b) provide a general Docker arguments field.

Imported from Jira [BEAM-5440](https://issues.apache.org/jira/browse/BEAM-5440). Original Jira may contain additional context.
Reported by: mxm.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.