globus / globus/globus-compute

Consider to remove the python version check on funcx interchange

Open
#244 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
162
Forks
53
Avg merge
15h 29m
Merged PRs (30d)
26

Description

Currently, funcx interchange checks if the python versions of manager and interchange match each other. If it does not match, interchange just ends itself and restarts.

This is not very necessary. We check the python version because of serialization. We can probably work around that by pinning the pickle version (and other serializers as well).

Also, it might be better to just raise an exception message like `unable to deserialize`.

Contributor guide

Open the contributing guide

Research direction

Locate the Python-version check in the funcx interchange and trace how manager/interchange serialization failures are handled. Determine whether serializer versions can be pinned, then verify that a version mismatch no longer restarts interchange and that deserialization failures produce an "unable to deserialize" exception.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend, distributed-systems
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.