mlcommons / mlcommons/endpoints
Schema-aware adapter selection (drop hard-required 'prompt' column / ColumnFilter skip)
@Palanivelg is already working on this.
Since Jul 22, 2026.
- Dominant language
- Python
- Stars
- 21
- Forks
- 28
- Avg merge
- 3d 17h
- Merged PRs (30d)
- 13
Description
Follow-up to #346 (review thread on dataset_manager/dataset.py — ColumnFilter).
The default OpenAIMsgspecAdapter hard-requires required_columns=['prompt'], so messages-schema datasets (e.g. BFCL function-calling presets) rely on Dataset.load() skipping the adapter's ColumnFilter when the dataset supplies its own projection. That skip is a deliberate, documented bridge but works around a schema mismatch rather than resolving it.
Goal: schema-aware adapter selection/negotiation so the adapter's default projection matches the dataset schema (prompt vs messages+tools) without the skip heuristic. Deferred from #346 to keep it scoped.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.