dask / dask/distributed

Client.submit does not use the custom serialization

Open
#1,749 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

The example below explains it well I think, I can scatter a hdf5 file instance, but not use it directly as argument, which is a bit unexpected.
```python
import h5py
f = h5py.File('/Users/maartenbreddels/datasets/nytaxi/nyc_taxi2015.hdf5', 'r')
def echo(f):
return f.filename
f_future = client.scatter(f)
#client.submit(echo, f).result() # this fails, it tries to use pickle
client.submit(echo, f_future).result() # this works fine
```
Is there a reason for this, or is this a bug, or missing feature?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.