allenai / allenai/olmocr

Significant difference of performance between online demo and local inference

Open
#174 5 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
19.5k
Forks
1.6k
PR merge metrics
No merged PRs in 30d

Description

### 🐛 Describe the bug

There is a significant difference of performance between online demo and local inference but I can't find the reason. For example, online demo processed this page as expected. However, the local deployed version found it `JSON decode error`. I checked the raw output of the model, it kept repeating some content and its result on table recognition is also worse than the online demo.

Are there any suggestions for me?
[error_page.pdf](https://github.com/user-attachments/files/19774564/error_page.pdf)

Image

### Versions

version 0.1.61, installed from source.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.