mattpocock / mattpocock/evalite
Command to start the UI without running evals
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- TypeScript
- Stars
- 1.7k
- Forks
- 102
- PR merge metrics
- No merged PRs in 30d
Description
Evals can be expensive, and Evalite provides a mechanism for persistence. A command to start the UI to check previous logs and results without running again could be useful.
These are the current commands:
COMMANDS
run Run evals once and exit
serve Run evals once and serve UI
watch Watch evals for file changes
export Export static UI bundle for CI artifacts
Something evlite ui could work.
Version: 1.0.0-beta.8
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the existing serve command and the persistence flow used for previous logs and results. Add a UI-only command that does not rerun evals, then verify it opens the UI with persisted results available.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- cli, frontend
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100