JuliaParallel / JuliaParallel/DistributedNext.jl
Observability support
- Lingua principale
- Julia
- Stelle
- 27
- Fork
- 1
- Merge medio
- 16m
- PR unite (30g)
- 1
Descrizione
Things that we could do:
- Keep counters that track communication statistics between workers, like the number of RPC calls and the amount of data sent/received.
- Expose a hook API so packages can register functions that will be called on sending/receiving data. Not sure about the performance implications of this.
- Read-only API to check the status of a worker, the time of last contact, and state of worker-to-worker connections.
Use cases:
- Tracking network usage between workers on HPC clusters
- Better support for profiling tools like Extrae (https://github.com/JuliaParallel/DistributedNext.jl/issues/1#issuecomment-2437194907)
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Direzione di ricerca
No files or tests are named. Start by tracing worker-to-worker communication in DistributedNext.jl and review the linked Extrae discussion; first narrow whether the contribution is counters, hooks, or a worker-status API. Done requires an agreed scope and observable communication or profiling data.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Valutazione
- Stack tecnologico
- julia
- Ambito
- distributed-systems, hpc, observability
- Tipo di issue
- Funzionalità
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Stato di attività
- Tranquilla
- Chiarezza
- Da chiarire
- Idoneità per principianti
- 35/100