Question about reproducing MoGe-2 evaluation results
Nobody has claimed this yet.
- Dominant language
- JavaScript
- Stars
- 3k
- Forks
- 234
- PR merge metrics
- No merged PRs in 30d
Description
Hello,
I have a question regarding the evaluation metrics for MoGe-2.
I evaluated MoGe-2 following the evaluation procedure used for MoGe-v1 that you provided, and used the model Ruicheng/moge-2-vitl-normal. However, the results I obtained do not exactly match the numbers reported in the paper.
I noticed that in a previous discussion you mentioned that the evaluation code for MoGe-2 has not been officially released yet. Could this be the reason why the reproduced results are inconsistent with the reported ones?
Thank you very much for your time and help.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue asks whether unreleased MoGe-2 evaluation code explains the mismatch with the paper's results. Start by reviewing the MoGe-v1 evaluation procedure and the referenced previous discussion, then compare those instructions with the reported MoGe-2 numbers. Done means clarifying the official evaluation procedure or code availability.
Written by the indexing model from the issue text.
Assessment
- Domain
- computer-vision, machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100