norrisaftcc / norrisaftcc/algorithm-liza

M2: run_tests tool and the edit-test-repair loop

Open
#8 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

area:tools milestone:M2 type:feat
Dominant language
Python
Stars
0
Forks
0
Avg merge
1m
Merged PRs (30d)
1

Description

The fourth v0 tool: run pytest against a fixed path and return the result. Deliberately not a shell — narrow enough to be safe, and the only execution feedback this task class needs.

The interesting part is what comes back. Raw pytest output is long, and most of it is noise that will crowd a small context window. Truncate and summarise: the failing test name, the assertion, and the relevant traceback frame. How aggressively to trim is an empirical question the transcripts will answer.

Done when, given a spec and a failing test file, LIZA writes a module, runs the tests, reads the failure and revises — at least one unaided cycle against a local model. This is the project's early definition of done.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Begin by running pytest against the specified failing test file and inspect the current v0 tool entry point. Implement the narrow test runner and output trimming so the failing test name, assertion, and relevant traceback frame are returned; done when LIZA completes at least one unaided edit-test-repair cycle with a local model.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
devtools, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.