huggingface / huggingface/dataset-viewer

Include code snippets for other libraries?

Open
#2,986 4 comments 0 reactions 0 assignees View on GitHub
P2 question
Dominant language
Python
Stars
899
Forks
130
Avg merge
9h 26m
Merged PRs (30d)
14

Description

For example, in https://github.com/huggingface/huggingface.js/pull/797, we add `distilabel`, `fiftyone` and `argilla` to the list of libraries the Hub knows. However, the aim is only to handle the user-defined tags better, not to show code snippets.

In this issue, I propose to discuss if we should expand the list of dataset libraries for which we show code snippets. For now, we support pandas, HF datasets, webdatasets, mlcroissant and dask.

We already mentioned polars as a potential new lib, I think. Maybe duckdb too?

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the dataset viewer's existing code-snippet handling for pandas, HF datasets, webdatasets, mlcroissant, and dask, then compare the proposed polars and duckdb support. Define which additional libraries should be supported and what snippets they require; done when the scope and acceptance criteria are agreed.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, pandas, python
Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.