Flaky test: tests/snuba/api/endpoints/test_organization_tagkey_values.py::TransactionTagKeyValues::test_duration
Open
Nobody has claimed this yet.
flaky-test
- Dominant language
- Python
- Stars
- 44.8k
- Forks
- 4.9k
- Avg merge
- 21h 23m
- Merged PRs (30d)
- 607
Description
Failing test: tests/snuba/api/endpoints/test_organization_tagkey_values.py::TransactionTagKeyValues::test_duration
Sentry sha: ab471d2d1ede60c8a8c1e3911b78a71a83261eae
Run: https://github.com/getsentry/sentry/actions/runs/22271635537
[1m[31mtests/snuba/api/endpoints/test_organization_tagkey_values.py[0m:553: in test_duration
self.run_test("transaction.duration", expected=[("5000", 1), ("3000", 1)])
[1m[31mtests/snuba/api/endpoints/test_organization_tagkey_values.py[0m:531: in run_test
super().run_test(key, expected, **kwargs)
[1m[31mtests/snuba/api/endpoints/test_organization_tagkey_values.py[0m:35: in run_test
assert [(val["value"], val["count"]) for val in response.data] == expected
[1m[31mE AssertionError: assert [('4999', 1), ('3000', 1)] == [('5000', 1), ('3000', 1)][0m
[1m[31mE [0m
[1m[31mE At index 0 diff: ('4999', 1) != ('5000', 1)[0m
[1m[31mE [0m
[1m[31mE Full diff:[0m
[1m[31mE [[0m
[1m[31mE ([0m
[1m[31mE - '5000',[0m
[1m[31mE + '4999',[0m
[1m[31mE 1,[0m
[1m[31mE ),[0m
[1m[31mE ([0m
[1m[31mE '3000',[0m
[1m[31mE 1,[0m
[1m[31mE ),[0m
[1m[31mE ][0m
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by running tests/snuba/api/endpoints/test_organization_tagkey_values.py::TransactionTagKeyValues::test_duration and review the run linked in the issue. Trace the setup used by run_test for transaction.duration and determine why 5000 is intermittently returned as 4999; done means the test passes consistently with the intended values.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend, testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100