codingjoe / codingjoe/threadmill

Add worker pool telemetry

Offen
#18 0 Kommentare 0 Reaktionen 1 zugewiesene Person Beansprucht von @codingjoe Auf GitHub ansehen
enhancement
Vorherrschende Sprache
Python
Sterne
12
Forks
1
Ø Merge
1 T. 1 Std.
Gemergte PRs (30 T.)
10

Beschreibung

We already have queue telemetry, but it would be cool to monitor the health of the worker pool too.

I would love be able to toggle between queue and worker view.

The [psutil](https://github.com/giampaolo/psutil) package allows us to telemetry per node. Via Redis PUB/SUB, we can feed it back to the inspector and display it. I'm thinking of a similar interface like btop or htop (two top alternatives with a nice TUI and graphs).

Some metrics I would be interested in:

node mem
node cpu
node task throughput (tasks per minute)

worker throughput
worker memory allocation
worker CPU allocation

The graphs for throughput, cpu & mem should remain at the same position while displaying different data depending on what is selected.

The selection should be happening via a tree. Queue -> node -> worker
While nodes can repeat per queue, if multiple nodes are listening to the same queue.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.