Register package mismatches for serialization with cloudpickle 2.0.0
Open
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 778
- Avg merge
- 2h 50m
- Merged PRs (30d)
- 3
Description
As of cloudpickle 2.0.0 (cloudpipe/cloudpickle#417) you can now manually register external dependencies to be pickled.
Currently, if we see a version mismatch between packages on the client and workers we show a warning to the user.
I wonder with this new feature whether we could instead register those packages for serialization so that the client-side packages are pickled and sent to the workers.
Thoughts?
Contributor guide
Assessment
This issue has not been assessed yet.