allenai / allenai/olmocr

[Feature Request] 3B Model

Aperta
#340 5 commenti 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
19.5k
Fork
1.6k
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

### 🚀 The feature, motivation and pitch

I have seen that many users have constrained hardware choices/or are converting pdfs at large scales. Would it be beneficial to train a 3B model (based on Qwen2.5-vl)?

Besides the speedup from switching to a smaller model, we can also further tune for speculative decoding methods such as EAGLE which in turn would make inference of the base model faster.

If that sounds reasonable, I would love to help and contribute to creating this.

### Alternatives

_No response_

### Additional context

(For me specifically, I have to convert ~1M pdfs and I don't have enough compute to do this in a reasonable timeframe)

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.