aws-samples / aws-samples/foundation-model-benchmarking-tool
Dataset handling if any of the keys have missing fields
Open
- Dominant language
- Jupyter Notebook
- Stars
- 256
- Forks
- 44
- PR merge metrics
- No merged PRs in 30d
Description
If a hugging face dataset contains two keys, for example an input and context, and if either of the keys contain missing values, then we need to handle that by appending the populated fields to the input and the rest of the empty fields go away, so that all of the contexts are handled properly.
Contributor guide
Research direction
Locate the Hugging Face dataset handling entry point and reproduce a case where the input or context key contains missing values. The work is done when populated fields are appended to the input, empty fields are omitted, and all contexts are handled properly.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface
- Domain
- data, machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100