apache / apache/beam

Preoptimize causes error with environment setup

Open
#20,029 0 comments 0 reactions 0 assignees View on GitHub
bug core P3 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Setting \--experiments=pre_optimize=all causes an error with StatisticsGen in the TFX taxi example pipeline [1]:

File "[redacted]/apache_beam/runners/portability/fn_api_runner_transforms.py", line 250, in executable_stage_transform
environment=components.environments[self.environment],
TypeError: None has type NoneType, but expected one of: bytes, unicode [while running 'Run[StatisticsGen]']

cc [~angoenka]

[1] https://github.com/tensorflow/tfx/blob/ff314a6803675548c89a016a5110a91e5bf98024/tfx/examples/chicago_taxi_pipeline/taxi_pipeline_portable_beam.py#L155

Imported from Jira [BEAM-9445](https://issues.apache.org/jira/browse/BEAM-9445). Original Jira may contain additional context.
Reported by: ibzib.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.