allenai / allenai/olmocr

Jupyter kernel crashes during olmocr installation on Vast.ai PyTorch instances

Aberta
#385 0 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
Python
Estrelas
19.5k
Forks
1.6k
Métricas de merge de PRs
Nenhum PR com merge em 30d

Descrição

Problem Description
The Jupyter notebook for olmOCR-2 LoRA fine-tuning crashes consistently during package installation on Vast.ai instances. The kernel dies when attempting to install the olmocr library and its dependencies, specifically during the flash-attention compilation step.

Environment
Platform: Vast.ai cloud instances
Template: PyTorch (pre-installed PyTorch environment)
GPU: RTX 3090 (24GB VRAM)
RAM: 12-24GB system RAM
CPU: 8 cores
Storage: 100GB disk
OS: Ubuntu (Vast.ai default)
Python: 3.12
CUDA: 12.8

Steps to Reproduce
Rent Vast.ai instance with PyTorch template (RTX 3090)
Clone repository and

!pip install git+https://github.com/allenai/olmocr.git
!pip install .[train]
!pip install transformers==4.52.4
!pip install flash-attn>=2.8.0.post2 --no-build-isolation
!pip install peft>=0.8.0
!pip install accelerate>=0.25.0
!pip install wandb

Attempted Solutions
Tried installing packages sequentially
Used --no-cache-dir flag
Skipped flash-attention installation
Used conda instead of pip
Checked for PyTorch version conflicts

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.