aws-samples / aws-samples/foundation-model-benchmarking-tool

Dataset handling if any of the keys have missing fields

Open
#281 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
256
Forks
44
PR merge metrics
No merged PRs in 30d

Description

If a hugging face dataset contains two keys, for example an input and context, and if either of the keys contain missing values, then we need to handle that by appending the populated fields to the input and the rest of the empty fields go away, so that all of the contexts are handled properly.

Contributor guide

Open the contributing guide

Research direction

Locate the Hugging Face dataset handling entry point and reproduce a case where the input or context key contains missing values. The work is done when populated fields are appended to the input, empty fields are omitted, and all contexts are handled properly.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface
Domain
data, machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.