GuyTevet / GuyTevet/motion-diffusion-model

Performance Degradation in HumanML3D

Open
#243 11 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
4.1k
Forks
462
PR merge metrics
No merged PRs in 30d

Description

Hello,
▪️I followed the instructions on GitHub step by step to prepare the [HumanML3D dataset ](https://github.com/GuyTevet/motion-diffusion-model?tab=readme-ov-file#b-full-data-text--motion-capture) and conducted an evaluation.

![Image](https://github.com/user-attachments/assets/60bdcbf9-290a-466b-b1e9-cfdb318ec167)

▪️I only performed the evaluation using the humanml-encoder-512 pretrained model, yet I observed a **performance degradation.**

![Image](https://github.com/user-attachments/assets/0b20b7aa-120e-4bea-ad7b-70ca046e5d7a)

▪️It seems like there is an issue with the dataset or the process, but I am unable to determine the cause, so I would like to ask for help.

For reference, I followed all the instructions for HUMANML3D, and the number of files in motion-diffusion-model/dataset/HumanML3D/new_joint_vecs was 29,228.

Best regards

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the README's HumanML3D preparation instructions and reproduce the evaluation using the humanml-encoder-512 pretrained model. Check the dataset/HumanML3D/new_joint_vecs contents, including the reported 29,228 files, against the evaluation inputs and reported results; done means identifying whether the degradation comes from the dataset or preparation process and documenting the cause.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.