Running apache beam dataflow pipeline throwing error: ImportError: No module named gunicorn.app.wsgiapp
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
I have created app-engine cron jobs to run python flask app which calls dataflow beam pipeline to ingest data into bigquery.
Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 766, in run self._load_main_session(self.local_staging_directory) File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 482, in _load_main_session pickler.load_session(session_file) File "/usr/local/lib/python2.7/dist-packages/apache_beam/internal/pickler.py", line 254, in load_session return dill.load_session(file_path) File "/usr/local/lib/python2.7/dist-packages/dill/dill.py", line 363, in load_session module = unpickler.load() File "/usr/lib/python2.7/pickle.py", line 864, in load dispatchkey File "/usr/lib/python2.7/pickle.py", line 1096, in load_global klass = self.find_class(module, name) File "/usr/local/lib/python2.7/dist-packages/dill/dill.py", line 423, in find_class return StockUnpickler.find_class(self, module, name) File "/usr/lib/python2.7/pickle.py", line 1130, in find_class *import*(module) ImportError: No module named gunicorn.app.wsgiapp
Imported from Jira [BEAM-6752](https://issues.apache.org/jira/browse/BEAM-6752). Original Jira may contain additional context.
Reported by: luvneries.
Contributor guide
Assessment
This issue has not been assessed yet.