mlcommons / mlcommons/endpoints
Mapping the config-template.yaml file from endpoints to user.conf file for submission checker
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 21
- Forks
- 28
- Avg merge
- 3d 17h
- Merged PRs (30d)
- 13
Description
The closest equivalent to user.conf currently available in the endpoints workflow seems to be config-template.yaml. We may need to introduce a wrapper or transformation layer to convert this configuration into the format expected by the inference submission checker.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading config-template.yaml and identifying the submission checker's expected user.conf format. Compare the available endpoint configuration fields with that format and trace the endpoints workflow to locate where a wrapper or transformation would fit. Done means the mapping approach is defined and the resulting configuration is accepted by the submission checker.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100