lablup / lablup/backend.ai

Revamp End-to-End testing

Open
#1,729 1 comment 0 reactions 2 assignees Claimed by @SangwonYoon View on GitHub
Dominant language
Python
Stars
670
Forks
183
Avg merge
17h 7m
Merged PRs (30d)
358

Description

### Main idea

Since Backend.AI project is getting complicated even more these days, it is almost impossible for us to test core functionalities only with our hands. Therefore I think this is the right time to revamp our old fashioned integration test package and introduce a daily E2E testing CI pipeline.

- [x] Update (or rewrite) `ai.backend.test.cli_integration` package so that it can be ran and report errors
- [ ] Add new test cases for other uncovered CLI features
- [ ] Create a Github action pipeline to execute the integration on a daily basis
### Alternative ideas

_No response_

### Anything else?

_No response_

JIRA Issue: BA-175

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.