dask / dask/distributed

Dask Client return SystemError: unknown opcode on trying to fetch result back from future object

Open
#3,525 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

I trying to use one of our custom package that does s3 download from our internal data lake with dask. It looks like the package is recognized by scheduler and workers but when I try to submit my function that makes a call to custom service to download file on fetch results from future object I am getting System Error as below.
Traceback (most recent call last):
File "/Users/212799563/work/segment-poc-withdask/dask-ai-io.py", line 26, in
prd_download_filepath.result()
File "/Users/212799563/work/segment-poc-withdask/venv/lib/python3.7/site-packages/distributed/client.py", line 222, in result
raise exc.with_traceback(tb)
File "/Users/212799563/work/segment-poc-withdask/dask-ai-io.py", line 17, in datalake_image_download
res = s3_service.get([s3_uri], filepath)
SystemError: unknown opcode

**Below I have added my code:**

from dask.distributed import Client

client = Client("tcp::8786")
from eai_io.clients.s3_client import S3Client >> eai_io is our custom package

def datalake_image_download(uri,org_id):
s3_uri = uri
contract_id = '1234556'
filepath = '/tmp/'
s3_service = S3Client(org_id, contract_id)
res = s3_service.get([s3_uri], filepath)
if res[0][0]['objectKey']:
return res[0][0]['objectKey']

prd_download_filepath = client.submit(datalake_image_download,prd_uri,org_id)
prd_download_filepath.result()

Also there is no package version mismatch across client, worker,scheduler

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.