JuliaParallel / JuliaParallel/Dagger.jl
Wrap inputs in Chunk only once, or not at all
Open
data movement
help wanted
performance
- Dominant language
- Julia
- Stars
- 723
- Forks
- 90
- Avg merge
- 1d 37m
- Merged PRs (30d)
- 9
Description
In #199 I've fixed a "bug" where non-thunk inputs are serialized during the thunk RPC call, which is silly for large inputs. That fix assumes that inputs are large enough to wrap in a Chunk, which is not always true. It also re-wraps inputs in Chunks multiple times, which can incur extra overhead. We should make a dynamic decision whether to wrap in a Chunk, and if we wrap, wrap just once.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.