DeFiCh / DeFiCh/ain

Flaky Tests Tracker

Open
#3,012 3 comments 0 reactions 0 assignees View on GitHub
bug tracker
Dominant language
C++
Stars
397
Forks
129
PR merge metrics
No merged PRs in 30d

Description

### Documenting flaky tests

- Most flaky tests are related to concurrency and how soon the node gets running, system resources and minor timing effects due to it. However, documenting them as we can aim to fix it and not ensure we don't end up adding new ones to it.
- Majority of them can be re-created with varying concurrency with `MAKE_JOBS=32/64/128/256` etc, and also selecting different numbers or tests at random, and/or limiting resources with cgroups.

#### Wide spectrum

- [Fixed] Failing to start and get nodes responsive in time: https://github.com/DeFiCh/ain/pull/3011 aims to fix majority of that. But there might still be a few that still persists.

#### Localized

- `wallet_txn_doublespend.py`
- This checks for initial block download and fails. If we loop through it to wait for longer, this should be fixed.
- `feature_token_merge.py`
- This seems to be something in test that's out of sync
```
test_framework.authproxy.JSONRPCException: Test AddPoolLiquidityTx execution failed:
tx must have at least one input from account owner (-32600)
```
- `feature_evm_gas.py`
- TODO
- `rpc_getcustomtx.py`
- Hits line 66: assert_equal(result["valid"], True) fails when there's high concurrency
- [Fixed] Ubuntu 24.04 related: https://github.com/DeFiCh/ain/pull/3010
- `feature_loan_basics.py`
- https://github.com/DeFiCh/ain/actions/runs/10571671467/job/29288144911?pr=3002
- https://github.com/DeFiCh/ain/issues/3012#issuecomment-2311637551
- `feature_evm_contracts.py`
- https://github.com/DeFiCh/ain/issues/3012#issuecomment-2312425282
- https://github.com/DeFiCh/ain/actions/runs/10571671467/job/29304455811?pr=3002
- `feature_loan_low_interest.py`
- https://github.com/DeFiCh/ain/actions/runs/10645509447/job/29511380330?pr=3018
- https://github.com/DeFiCh/ain/issues/3012#issuecomment-2323128933

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.