mindspore-ai / mindspore-ai/hyper-parallel

[Bug]: incorrect logging message in hyper-parallel trainer

Open
#840 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
53
Forks
63
Avg merge
23h 45m
Merged PRs (30d)
63

Description

Checklist
  • 1. I have searched the existing issues (https://gitcode.com/mindspore/hyper-parallel/issues)
  • 2. I have read the relevant documentation.
  • 3. I have created a minimal reproduction case that clearly demonstrates the issue, including a complete code example and the error message with full traceback and error logs.
🐛 Describe the bug
  1. multiply tqdm rows in one training step
  2. report zero tokens/s in training logging
Expected behavior
  1. one tqdm row for one training step
  2. actual value of tokens/s
Additional context

No response

Environment info

any cann | torch version

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by running the minimal reproduction described in the issue and observe the trainer's tqdm output and tokens/s value during one training step. Trace the training logging and progress-display entry points to determine why multiple rows appear and tokens/s is zero; done means one row per step and the actual tokens/s value is reported.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.