User failed to retrieve log when node be preempted
Open
Nobody has claimed this yet.
1st party users
Azure LP
pai-dev
- Dominant language
- JavaScript
- Stars
- 2.7k
- Forks
- 554
- Avg merge
- 20h 42m
- Merged PRs (30d)
- 14
Description
When using PAI in Azure low priority vm, some nodes maybe preempted by Azure.
If that happens, the log files in the preempted vm will become unreachable.
Maybe we need a centralized log server to collect user logs.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing how PAI handles user logs on Azure low-priority VMs and what happens when a node is preempted. Investigate the requirements for centralized log collection and retrieval, including storage and failure behavior. Done means users can retrieve logs after the originating VM is preempted.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure
- Domain
- cloud, observability-sre
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100