apache / apache/beam

Verify that Python version used to launch pipeline matches the Python version that runs sdk_worker.

Open
#20,797 0 comments 0 reactions 0 assignees View on GitHub
bug core P3 python usability
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

We should verify that (major.minor) Python version at launch time matches the version on the workers, and alert users with an error when this is not the case.
Otherwise the job may fail with cryptic errors during DoFn un-pickling such as 'SystemError: unknown opcode'.

Imported from Jira [BEAM-11623](https://issues.apache.org/jira/browse/BEAM-11623). Original Jira may contain additional context.
Reported by: tvalentyn.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.