Enhance REST API to allow querying for flow setup and performances
Open
Nobody has claimed this yet.
- Dominant language
- PHP
- Stars
- 755
- Forks
- 128
- PR merge metrics
- No merged PRs in 30d
Description
We quickly talked about this today.
Basically querying for a combination of evaluations and corresponding hyperparameters is very cumbersome. This might be solved by doing a join on the database and then offering an API to query against.
Description
Example
What I would like to be able to query is:
- all results from all runs of flow f for task d.
- predictive_accuracy (I guess this might then be possible) for all runs of flow f on task d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the REST API entry points and the database records for flows, evaluations, hyperparameters, tasks, and runs. Define how the proposed queries should join those records and what response format covers the two examples; the work is done when both example queries are supported and tested.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- php
- Domain
- api, database, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100