allenai

SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.

Sterne

35

Forks

6

Offene Anfänger-Issues

0

Indexierte Issues

1