huggingface / huggingface/dataset-viewer

Don't try to include binary cells in the /rows responses

Open
#3,052 1 comment 0 reactions 0 assignees View on GitHub
improvement / optimization P1
Dominant language
Python
Stars
900
Forks
131
Avg merge
9h 26m
Merged PRs (30d)
14

Description

https://huggingface.co/datasets/frutiemax/themoviedb_posters/discussions/2

> I have some columns that the viewer do not need to load i.e. T5 prompt embeds and VAE features. Currently, the viewer freezes because the dataset is too big to load. Thanks.

Capture d’écran 2024-08-28 à 12 31 40

https://huggingface.co/datasets/frutiemax/themoviedb_posters/viewer/default/train lags forever to render the following:

Capture d’écran 2024-08-28 à 12 32 50

We should ignore/hide the binary cells (`bytes (5KB)` for example)

Contributor guide

Open the contributing guide

Research direction

Start at the /rows response handling and trace how binary cells such as `bytes (5KB)` are included. Confirm the response behavior for datasets containing binary columns, then verify that those cells are omitted or hidden and that the dataset viewer no longer freezes while rendering the rows.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, backend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.