alteryx / alteryx/evalml

Flaky threaded parallelism unit test

Open
#2,969 3 comments 0 reactions 1 assignee Claimed by @asniyaz View on GitHub
bug testing
Dominant language
Python
Stars
850
Forks
96
PR merge metrics
No merged PRs in 30d

Description

We saw `test_score_pipelines_passes_X_train_y_train[multiclass-cf_threaded]` flake on the linux nightlies on 2021-10-27.

Logs are [here](https://github.com/alteryx/evalml/runs/4018971157?check_suite_focus=true)

We've seen this flake a couple of times (@angela97lin saw it fail on her PR once) so we're recording it here to see how widespread the problem is.

Although this is similar to #2669, that issue tracks figuring out why the process-based parallelism tests (now removed) used to flake.

Closing out this issue involves figuring out why this test can flake and proposing a fix if possible.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.