Testing & QA Good First Issues

Browse open source issues grouped under Testing & QA. Where the subject goes by older names in the issue metadata, those are matched too.

Testing & QA

Slice signals

Average annotated difficulty: 3.6/5 across 1,660 issues.
14% of 1,660 time estimates are one day or less.

Open All

[BUG] Windows: Claude Code CLI corrupts stdio MCP password arguments when launching npx through cmd.exe Open

area:mcp bug has repro platform:windows

anthropics/claude-code#91526 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[BUG] Four shipped plugin agents fail YAML frontmatter parsing and load as placeholders or not at all Open

area:agents area:plugins bug has repro platform:linux

anthropics/claude-code#91871 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
plugin eval: scope `target: trace` to the graded run's own events Open

area:plugins enhancement

anthropics/claude-code#92017 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Supported isolated auth and observable skill-to-agent dispatch for native skill evaluations Open

area:permissions area:skills question

anthropics/claude-code#92726 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Model asserts measurement provenance it never obtained (fabricated timestamps and command results) Open

area:agents area:model bug platform:macos platform:vscode

anthropics/claude-code#92732 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Cyber policy false positive on defensive security tool's own regression tests Open

area:model area:security bug platform:vscode platform:windows

anthropics/claude-code#93410 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Workflow tool's StructuredOutput validator false-rejects valid output ("missing required property" when property is present) Open

area:agents area:routines duplicate

anthropics/claude-code#93430 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Opus 5] Every hook held. The model went around them. Six seam failures in one session under twelve enforced rules — and the two harness affordances that would close the seams Open

area:hooks area:model enhancement platform:vscode platform:windows

anthropics/claude-code#93900 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
skill-creator: run_eval trigger detection reports ~0 on current Claude Code (slash-command injection mismatch) + Windows select() bug Open

anthropics/claude-plugins-official#3172 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
`run_eval.py` always reports 0% recall: it probes a `.claude/commands/` slash-command proxy instead of the real installed skill Open

anthropics/claude-plugins-official#3174 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
skill-creator eval harness (run_eval.py) reports 0 triggers for every skill on Claude Code 2.1.x Open

anthropics/claude-plugins-official#4425 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
skill-creator: trigger eval reports ~0% recall for almost any skill Open

anthropics/claude-plugins-official#4692 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
code-simplifier and agent-sdk-verifier-py assert verification results they never execute Open

anthropics/claude-plugins-official#4785 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
security-guidance: failed LLM reviews still mark commits as reviewed Open

anthropics/claude-plugins-official#5322 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
skill-creator: description-eval harness cannot detect the trigger route it installs, and leaks its per-run command files Open

anthropics/claude-plugins-official#5375 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
skill-creator: run_eval.py omits --strict-mcp-config, so the operator's MCP servers are charged against a 30s per-query timeout Open

anthropics/claude-plugins-official#5624 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[MODEL] Self-authored tests do the work of the code under test — hand-seeded fixtures masked a broken paid feature (271-incident retro, 3/5) Open

anthropics/claude-code#94170 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
e2e tests for copy/paste handling in the experimental editor Open

ankitects/anki#5338 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add SDK support for bounded Snowflake destination queries Open

airbytehq/airbyte-api-python-sdk#212 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
declarative: ConcurrencyLevel is built from the pre-migration config, so config migrations do not affect concurrency on the sync that performs them Open

community

airbytehq/airbyte-python-cdk#1147 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
`MovingWindowCallRatePolicy.update` ignores the remaining-calls header (bool `items_to_add`), and `HttpAPIBudget` parses relative-seconds reset headers as epoch timestamps Open

airbyte-python-cdk/low-code bug community

airbytehq/airbyte-python-cdk#1151 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature]: 网页控台发送文件后自动折叠误导用户 Open

enhancement

agentscope-ai/QwenPaw#7744 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug]: test_read_nonexistent_file fails on Windows with Python 3.13+ (ntpath.isabs change) Closed

agentscope-ai/agentscope#2604 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug]: three tests fail on Windows dev machines without Git usr/bin on PATH (POSIX shell tool dependency) Open

agentscope-ai/agentscope#2608 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug]: DeveloperOrientedException can emit an empty success and leave tool calls unfinished Open

agentscope-ai/agentscope#2618 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug]: Python A2UI toolkit tests are not executed by the Python CI workflow Closed

ag-ui-protocol/ag-ui#2743 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug]: HttpSelfRegistration.close() skips deregistration when a heartbeat re-register cycle is in flight (flaky HttpSelfRegistrationTest on CI) Open

area/extensions bug

agentscope-ai/agentscope-java#3132 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Amazon Redshift test Open

appspace/kwwhat#154 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ci: add Node.js version matrix, caching, and lint step to test workflow Open

appbaseio/reactivesearch#2322 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Explore using ragger Open

ApeWorX/ape-ledger#56 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Home stack tab and secondary-view interaction state can become stale Open

AppFlowy-IO/AppFlowy#8950 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Benchmark iOS isolation needs native toolchain and recording compatibility checks Open

appandflow/stim#469 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Reduce duplicate release QA work with coverage-aware orchestration Open

appandflow/stim#598 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
listIosDevices can leave its temp directory behind, and the test that guards it asserts on the shared tmpdir Open

appandflow/stim#714 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Implement Unit Tests for `MeetingFormatter` Service Layer Open

AOSSIE-Org/Ell-ena#294 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Issues in `src/features` folder (Parent ID comparisons, onboarding loop timeouts, and type safety) Open

AOSSIE-Org/PictoPy#1379 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
BUG: Missing 'requests' in requirements.txt causes ModuleNotFoundError in API utils Open

bug enhancement

AOSSIE-Org/PictoPy#1533 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Evaluate changes to support less verbose BrowserKit from Symfony ^8.2 Open

api-platform/core#8450 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
ResourceMetadataCompatibilityTest fails when api-platform/elasticsearch is autoloaded Open

api-platform/core#8495 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Migrate package to ESM (dual build), following apex-parser Open

apex-dev-tools/benchmarker#95 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Switch to module nodenext and Node 22.12+ to unblock ESM-only dependencies (precursor to #95) Open

apex-dev-tools/benchmarker#113 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Test CRLF line endings for multiline string literals Open

enhancement

apex-dev-tools/apex-parser#158 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Metal SSD-streaming cache-pressure vector test fails at short_code_completion Open

antirez/ds4#439 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
DSpark preserved-MXFP4 planner support and mixed IQ2/MXFP4 Metal tests Open

antirez/ds4#642 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
test_metal_mpp_equivalence can pass without varying the Metal4 route (non-discriminating on CUDA) Open

antirez/ds4#792 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
speed-bench: variant harnesses show slot-order bias — control-vs-control logits mismatch (bit-exact A/B impossible on this config) Open

antirez/ds4#793 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
ds4-agent advertises ROCm backend options but rejects them on a Strix Halo build Open

antirez/ds4#829 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
ROCm/gfx1151: `--metal-kernels` fails 6 assertions in the paired Q8_0 decode case Open

antirez/ds4#859 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Help wanted: test DeepSeek V4 Flash Vision-Exp AProjQ4 on Metal, CUDA, and ROCm Open

antirez/ds4#929 · 13 comments · 1 reaction · 0 assignees · Indexed Sep 13, 2026
GLM --mtp on Metal (server): greedy output diverges from sequential decode, identical requests become nondeterministic, ignore_eos is ignored Open

antirez/ds4#938 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

Testing & QA Good First Issues

Slice signals

Showing the newest 100

Get new issues in your inbox