deepspeedai / deepspeedai/DeepSpeed
[REQUEST] Add Trackio as a New Backend for Experiment Monitoring
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
Is your feature request related to a problem? Please describe.
Trackio is a lightweight python library with a similar API to Wandb. It features an offline first design and the logging runs can be visualized as an HF Space or dataset on the HF Hub. I propose to add this backend to the existing Monitor Module backends.
I can help to integrate this backend to DeepSpeed, having done the same with optuna, ROLL and LlamaFactory WDYT?
Describe the solution you'd like
Integrate Trackio as New Logger Backend for Experiment Monitoring.
Describe alternatives you've considered
N.A.
Additional context
N.A.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with DeepSpeed's Monitor Module documentation and its existing monitoring backends, then review Trackio's Python logging API and offline-first behavior. Done means Trackio is integrated as an experiment-monitoring backend with behavior consistent with the existing backends.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, observability
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100