Basic ops metrics
Open
@sterowang is already working on this.
Since Mar 20, 2020.
pai-dev
- Dominant language
- JavaScript
- Stars
- 2.7k
- Forks
- 554
- Avg merge
- 20h 42m
- Merged PRs (30d)
- 14
Description
The ticket is to track efforts on design, develop the basic ops metrics/SLA for PAI.
Quality of Service
Key Metrics
Job success rate
Infrastructure success rate
Top infrastructure issues
Top user error
Definitions
Overall Jobs
| Jobs Type | Count |
|---|---|
| Succeeded | 1000 |
| Failed | 5 |
| Total | 1005 |
Failed Jobs breakdown by Error Category
| Failed Jobs Error Type | Count | Proportion |
|---|---|---|
| InfraError | 200 | 9.01% |
| Unknown | 20 | 0.9% |
| UserError | 2000 | 90.09% |
| Total | 2220 | 100% |
Failed Reason
| Failed Reason (or ErrorCode) | Count | ErrorCategory |
|---|---|---|
| DockerNotFound | 200 | UserError |
| LaucherFailed | 2 | InfraError |
System SLA
Key Metrics
| System Metric | SLA |
|---|---|
| Job submission API availability | more than 99% |
| Job submission success rate | more than 99% |
| Job completion rate | more than 99% |
| Job failure rate (due to system issue) | less than 10% |
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.