huggingface / huggingface/datasets

JPEG XL support

Open
#8,537 8 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
22k
Forks
3.4k
Avg merge
5d 7h
Merged PRs (30d)
17

Description

It seems that the dataset don't support JXL natively in the same ways as e.g. PNG and JPEG are supported. A JPEG XL is supported by an international ISO standard, gives great compression ratios, finally supports lossless for JPEG and the browser support is now starting to get wide spread (safari has it for some time -> https://caniuse.com/jpegxl, firefox and chrome have it in test mode and publicly stated recently an intention to ship https://groups.google.com/a/mozilla.org/g/dev-platform/c/3YMV4MS34KA?pli=1 and https://groups.google.com/a/chromium.org/g/blink-dev/c/-gDojQbDPRI)

I could find the old PR #5289 which might be the base. But I don't know whether that's sufficient or some more code changes are required to get e.g. the dataset viewer going.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing PR #5289 and the existing PNG and JPEG support paths in the datasets repository. Check whether those paths cover JPEG XL and whether the dataset viewer needs additional changes; done means JXL files work natively in the same ways as PNG and JPEG, including in the viewer.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.