allenai

SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.

Étoiles

35

Forks

6

Issues débutants ouvertes

0

Issues indexées

1