microsoft / microsoft/TRELLIS.2

Total Program Failure: Trellis2 DINOv3 extractor cannot load the HuggingFace DINOv3 model

Open
#161 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
11.3k
Forks
1.4k
PR merge metrics
No merged PRs in 30d

Description

I’m trying to use the DINOv3 extractor in Trellis2, but it doesn’t load the HuggingFace model (facebook/dinov3-vitl16-pretrain-lvd1689m). The extractor expects model.layer, but the HF model exposes model.model.layer. It also expects RoPE to return two tensors (cos, sin), while the HF model returns a single tensor, causing ValueError: expected 2, got 1.

Before I assume this is a bug, can you confirm whether the DINOv3 extractor is intended to work with the public HF DINOv3 model, or if a different model is required? Alternately is there a different version of the program I should be using?

Has anyone else been able to get this to work?

This seems like an absolute dealbreaker as far as using this software at all. If this doesn't work nothing works.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the Trellis2 DINOv3 extractor and reproduce loading facebook/dinov3-vitl16-pretrain-lvd1689m with the public HuggingFace model. Compare the extractor's model.layer and RoPE expectations with the model.model.layer structure and single-tensor RoPE result. Done means the intended model and version are confirmed, or compatibility is restored and the extractor loads successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.