allenai / allenai/olmocr

[vLLM] Response did not finish with reason code 'stop', cannot use this response

Open
#389 5 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
19.5k
Forks
1.6k
PR merge metrics
No merged PRs in 30d

Description

### 🐛 Describe the bug

**version: 0.4.4**
**vllm verison: v0.10.1.1**
**installation method: `uv add olmocr`**
command: python -m olmocr.pipeline ./olm --server http://localhost:8114/v1 --markdown --pdfs ./test/Extract\[955-968\].pdf --model vllm
other info: No error on vLLM endpoint logs, seems like endless generating

### Versions

0.4.4

### logs
```
2025-11-13 09:00:47,969 - __main__ - WARNING - ValueError on attempt 3 for ./test/Extract[6].pdf-1: - Response did not finish with reason code 'stop', cannot use this response
2025-11-13 09:00:54,982 - __main__ - INFO - Queue remaining: 0
2025-11-13 09:00:54,982 - __main__ - INFO -
Metric Name Lifetime (tokens/sec) Recently (tokens/sec)
----------------------------------------------------------------------------------
2025-11-13 09:00:54,982 - __main__ - INFO -
Worker ID | started
----------+--------
0 | 1
2025-11-13 09:01:04,990 - __main__ - INFO - Queue remaining: 0
2025-11-13 09:01:04,990 - __main__ - INFO -
Metric Name Lifetime (tokens/sec) Recently (tokens/sec)
----------------------------------------------------------------------------------
```

a ValueError problem ?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.