deepspeedai / deepspeedai/DeepSpeed

[REQUEST] Add Trackio as a New Backend for Experiment Monitoring

Open
#7,964 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
43.1k
Forks
5k
Avg merge
4d 15h
Merged PRs (30d)
112

Description

Is your feature request related to a problem? Please describe.
Trackio is a lightweight python library with a similar API to Wandb. It features an offline first design and the logging runs can be visualized as an HF Space or dataset on the HF Hub. I propose to add this backend to the existing Monitor Module backends.

I can help to integrate this backend to DeepSpeed, having done the same with optuna, ROLL and LlamaFactory WDYT?

Describe the solution you'd like
Integrate Trackio as New Logger Backend for Experiment Monitoring.

Describe alternatives you've considered
N.A.

Additional context
N.A.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with DeepSpeed's Monitor Module documentation and its existing monitoring backends, then review Trackio's Python logging API and offline-first behavior. Done means Trackio is integrated as an experiment-monitoring backend with behavior consistent with the existing backends.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.