microsoft / microsoft/TRELLIS.2
Total Program Failure: Trellis2 DINOv3 extractor cannot load the HuggingFace DINOv3 model
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 11.3k
- Forks
- 1.4k
- PR merge metrics
- No merged PRs in 30d
Description
I’m trying to use the DINOv3 extractor in Trellis2, but it doesn’t load the HuggingFace model (facebook/dinov3-vitl16-pretrain-lvd1689m). The extractor expects model.layer, but the HF model exposes model.model.layer. It also expects RoPE to return two tensors (cos, sin), while the HF model returns a single tensor, causing ValueError: expected 2, got 1.
Before I assume this is a bug, can you confirm whether the DINOv3 extractor is intended to work with the public HF DINOv3 model, or if a different model is required? Alternately is there a different version of the program I should be using?
Has anyone else been able to get this to work?
This seems like an absolute dealbreaker as far as using this software at all. If this doesn't work nothing works.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at the Trellis2 DINOv3 extractor and reproduce loading facebook/dinov3-vitl16-pretrain-lvd1689m with the public HuggingFace model. Compare the extractor's model.layer and RoPE expectations with the model.model.layer structure and single-tensor RoPE result. Done means the intended model and version are confirmed, or compatibility is restored and the extractor loads successfully.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100