allenai / allenai/olmocr

Demo extracts populated table, self-hosted run returns 'No document text` for same page

Ouverte
#443 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
19.5k
Forks
1.6k
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

Hi, I’m seeing a reproducible difference between the public demo and a self-hosted run on the same source page.

Input: [table.pdf](https://github.com/user-attachments/files/26090839/table.pdf)

`table.pdf` is an isolated single-page PDF containing page 11 from a source document.

### Demo result

The public demo extracts a populated table:
```html

...


Item No.
照合番号
Title
部品名称
No.off
数/台
Remarks
摘要


09001 - 1
CRANK SHAFT クランクシフト
1



09001 - 2
GEAR * CRANK SHAFT ギヤ*クランクシフト
1



09001 - 3
BALANCE WEIGHT バランスウェイト
12


```

### Self-hosted result

Processing that same page on my self-hosted setup produces:

- empty output JSONL
- no markdown output
- pipeline log says No document text

Relevant log excerpt:

```log
2026-03-18 08:07:45,094 - __main__ - INFO - Worker 0 processing work item bcf50651623799f21f81f99e45f6df300dfbbc9b
2026-03-18 08:07:45,094 - __main__ - INFO - Created all tasks for bcf50651623799f21f81f99e45f6df300dfbbc9b
2026-03-18 08:07:45,612 - __main__ - INFO - No document text for /input/table.pdf
2026-03-18 08:07:45,612 - __main__ - INFO - Finished TaskGroup for worker on bcf50651623799f21f81f99e45f6df300dfbbc9b
2026-03-18 08:07:45,612 - __main__ - INFO - Got 0 docs for bcf50651623799f21f81f99e45f6df300dfbbc9b
2026-03-18 08:07:45,613 - __main__ - INFO - Writing 0 markdown files for bcf50651623799f21f81f99e45f6df300dfbbc9b
```

final summary:

```log
Completed pages: 1
Failed pages: 0
Finished input tokens: 0
Finished output tokens: 0
```

### Environment
- olmocr version: 0.4.25
- model: allenai/olmOCR-2-7B-1025-FP8
- Docker-based setup on AWS EC2 (`g6e.xlarge`)
- The setup runs vLLM and olmOCR in separate Docker containers on the same network
- vLLM image: vllm/vllm-openai:latest
- olmocr image: alleninstituteforai/olmocr:latest-with-model

vLLM command:
```bash
vllm serve allenai/olmOCR-2-7B-1025-FP8 \
--host 0.0.0.0 \
--port 8000 \
--served-model-name olmocr \
--gpu-memory-utilization 0.9 \
--max-model-len 16384
```

pipeline command:
```bash
python -m olmocr.pipeline /output \
--server http://vllm:8000/v1 \
--model olmocr \
--pdfs "/input/table.pdf"
```

### Question

Is the public demo running the same model and pipeline path as the self-hosted setup above? If not, could you clarify what causes this discrepancy?

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.