huggingface / huggingface/candle
PaddleOCR-VL consider support bf16 or f16 inference
Open
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
current when set dtype to bf16 for model, it will raise an error.
Consider support bf16 support in vision part of paddleocr-vl
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the dtype error when PaddleOCR-VL inference is configured with bf16, then locate the vision inference path responsible. Done means bf16 and f16 inference are supported there without the reported error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- computer-vision, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100