intel / intel/torch-xpu-ops

Improve random label behavior

Open
#3,628 1 comment 1 reaction 1 assignee Claimed by @jmamzax View on GitHub
enhancement module: infra
Dominant language
Python
Stars
113
Forks
128
Avg merge
5d 9h
Merged PRs (30d)
112

Description

### 🚀 The feature, motivation and pitch

As it is now the random label prevent from closing issue when it pass. But also preventing from inserting comment with pass message so after adding random to issue there is no update from CI when issue pass or fail. Which in some cases is problematic as issue reproduce in specific condition.

### Alternatives

Add new check to ut_result_check.sh script to insert comment with information if test cases from issue marked as random fail or pass. This will give us clear history of nightly runs and also we will be able quickly check how often the problem occur.

### Additional context

I had issue: https://github.com/intel/torch-xpu-ops/issues/3195 marked as random and I was not able to find single nightly run that fail but I also don't check every run. Only fail is a pull request run. So with such nightly history I will be able to quickly tell if the test fail again.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.