agenticsorg / agenticsorg/community-projects

test: OIA classifier + pending/promote pipeline has zero test coverage

Open
#49 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

area/ci enhancement priority/p1
Dominant language
JavaScript
Stars
3
Forks
1
Avg merge
1m
Merged PRs (30d)
1

Description

npm test runs in CI, but nothing under test/ covers the OIA track: scripts/classify-oia.mjs, add-pending.mjs, promote-pending.mjs, build-badges.mjs, oia-intake-step.mjs. A regex typo or a schema-key rename ships to the live matrix unverified.

Ask: golden-fixture tests. Freeze a few captured GitHub tree/README JSON blobs, run classify() against them, assert the layer vector + spans + evidence tier. Add a promote/pending round-trip test over a fixture oia-matrix.json.

This is also the safety net that makes the accuracy refactor (de-noise corpus, add word boundaries) safe to land.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by running npm test and reading scripts/classify-oia.mjs, add-pending.mjs, promote-pending.mjs, build-badges.mjs, and oia-intake-step.mjs. Add captured GitHub tree/README JSON fixtures under test/ and assert classify() output for layer vectors, spans, and evidence tiers. Add a promote/pending round-trip over a fixture oia-matrix.json; done means the OIA track has golden-fixture coverage under test/.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
testing-qa
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Clearly specified
Newbie friendliness
74/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.