Flaky test: tests/sentry/feedback/lib/test_label_query.py::TestLabelQuery::test_query_recent_feedbacks_with_ai_labels
- Dominant language
- Python
- Stars
- 44.8k
- Forks
- 4.9k
- Avg merge
- 21h 10m
- Merged PRs (30d)
- 635
Description
Failing test: `tests/sentry/feedback/lib/test_label_query.py::TestLabelQuery::test_query_recent_feedbacks_with_ai_labels`
Sentry sha: ab471d2d1ede60c8a8c1e3911b78a71a83261eae
Run: https://github.com/getsentry/sentry/actions/runs/22271634857
```
[1m[31mtests/sentry/feedback/lib/test_label_query.py[0m:140: in test_query_recent_feedbacks_with_ai_labels
assert result[0] == {
[1m[31mE AssertionError: assert {'feedback': ..., 'Security']} == {'feedback': ...Performance']}[0m
[1m[31mE [0m
[1m[31mE Differing items:[0m
[1m[31mE {'labels': ['Authentication', 'Security']} != {'labels': ['Performance']}[0m
[1m[31mE {'feedback': 'b'} != {'feedback': 'The app crashes frequently when loading data'}[0m
[1m[31mE [0m
[1m[31mE Full diff:[0m
[1m[31mE {[0m
[1m[31mE - 'feedback': 'The app crashes frequently when loading data',[0m
[1m[31mE + 'feedback': 'b',[0m
[1m[31mE 'labels': [[0m
[1m[31mE - 'Performance',[0m
[1m[31mE + 'Authentication',[0m
[1m[31mE + 'Security',[0m
[1m[31mE ],[0m
[1m[31mE }[0m
```
Contributor guide
Research direction
Run tests/sentry/feedback/lib/test_label_query.py::TestLabelQuery::test_query_recent_feedbacks_with_ai_labels at Sentry SHA ab471d2d1ede60c8a8c1e3911b78a71a83261eae and read the assertion and test setup around line 140. Trace why the returned feedback and labels differ between runs; done means the test consistently produces its intended result without masking the failure.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100