huggingface / huggingface/candle

Adding support for LightOnOCR_2_1B

Open
#3,401 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

Hey I am trying to contribute my implementation of https://huggingface.co/lightonai/LightOnOCR-2-1B to candle. However I am running into bit of a issue where the model has a dependency on qwen3.

The weights for LightOnOCR are in the format:
```model.language_model.embed_tokens.weight```

But qwen3 expects
```model.embed_tokens.weight```

This wouldn't have been much of a problem if not for the implementation of qwen3 baking in the ```model``` part. This is my first time doing open source so I am not sure if I am allowed to change the implementation for qwen3 so any help would be greatly appreciated.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading Candle's qwen3 implementation and comparing its expected model.embed_tokens.weight names with LightOnOCR's model.language_model.embed_tokens.weight format. Determine the appropriate model-loading or qwen3 integration point, then verify that the LightOnOCR-2-1B weights can be loaded without breaking existing qwen3 support.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.