Lightning-AI / Lightning-AI/pytorch-lightning
The best practice to monitor the data loading time & training forward backward time
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 31.4k
- Forks
- 3.8k
- Avg merge
- 6d 7h
- Merged PRs (30d)
- 6
Description
📚 Documentation
Hi,
Is there any best practice to monitor the data loading time & training forward backward time for lightning 2.x?
The following doc seems outdated and not specific for data loading time monitor.
https://lightning.ai/docs/pytorch/stable/tuning/profiler_basic.html
cc @lantiga @borda
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Review the profiler_basic.html documentation linked in the issue and compare it with the current Lightning 2.x profiling behavior. Clarify how to monitor data-loading time and forward/backward training time, then update the documentation with current, specific guidance and verify that the examples match the supported profiler workflow.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- documentation, machine-learning, performance
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100