JuliaParallel / JuliaParallel/DistributedNext.jl

Observability support

Open
#64 11 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Julia
Stars
27
Forks
1
Avg merge
16m
Merged PRs (30d)
1

Description

Things that we could do:
- Keep counters that track communication statistics between workers, like the number of RPC calls and the amount of data sent/received.
- Expose a hook API so packages can register functions that will be called on sending/receiving data. Not sure about the performance implications of this.
- Read-only API to check the status of a worker, the time of last contact, and state of worker-to-worker connections.

Use cases:
- Tracking network usage between workers on HPC clusters
- Better support for profiling tools like Extrae (https://github.com/JuliaParallel/DistributedNext.jl/issues/1#issuecomment-2437194907)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.