demml / demml/opsml

TODOs

Open
#321 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
40
Forks
3
PR merge metrics
No merged PRs in 30d

Description

List of TODOs for merging new scouter and potatohead changes into opsml

- Delete all llm eval, genai eval in opsml - this has been moved to scouter (types, structs, etc)
- Update to latest pyo3 and pythonize
- UI updates
- GenAIEvalRecord (pagination)
- GenAI Workflow (Pagination, drift metrics)
- GenAI Task (drift metrics)
- Similar to tracing, when a user click on a workflow record they should be able to see all associated tasks

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.