globus / globus/globus-compute
Consider to remove the python version check on funcx interchange
- Dominant language
- Python
- Stars
- 162
- Forks
- 53
- Avg merge
- 15h 29m
- Merged PRs (30d)
- 26
Description
Currently, funcx interchange checks if the python versions of manager and interchange match each other. If it does not match, interchange just ends itself and restarts.
This is not very necessary. We check the python version because of serialization. We can probably work around that by pinning the pickle version (and other serializers as well).
Also, it might be better to just raise an exception message like `unable to deserialize`.
Contributor guide
Research direction
Locate the Python-version check in the funcx interchange and trace how manager/interchange serialization failures are handled. Determine whether serializer versions can be pinned, then verify that a version mismatch no longer restarts interchange and that deserialization failures produce an "unable to deserialize" exception.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend, distributed-systems
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100