Lightning-AI / Lightning-AI/litgpt

Git-LFS doesn't work for downloading `RedPajama-Data-1T` dataset

Open
#722 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

documentation
Dominant language
Python
Stars
13.7k
Forks
1.5k
Avg merge
15h 37m
Merged PRs (30d)
1

Description

Hi there 👋

In the tutorial `tutorials/pretrain_redpajama.md` it's said that you can download full-size and sample-size RedPajama dataset with help of `git lfs`.
At least as of right now, it's possible only for `sample` dataset.

On HF page for the `sample` dataset, you can find the list of `lfs` files: https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T-Sample/tree/main

But not for `full-size` version: https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T/tree/main

For the full-size variant, only URLs are provided.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Read tutorials/pretrain_redpajama.md and compare its Git LFS instructions with the sample and full-size Hugging Face dataset pages linked in the report. Done means the tutorial accurately explains how to obtain the full-size dataset, or clearly documents the URL-based alternative and limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
git
Domain
documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.