microsoft / microsoft/TRELLIS

Is there any data augmentation during the training of slat flow matching models?

Open
#350 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13.7k
Forks
1.3k
PR merge metrics
No merged PRs in 30d

Description

Thank you for your work!
When I'm testing the pretrained slat flow matching models, I found that this model is super robust to the generated coords (from the ss flow matching model). No matter the generated coords are with many false voxels/ small scaled geometry, it will accurately identify the correct subset and generate coherent slat feature for these voxels.
But I cannot find any scaling/ noise injection within the data process pipeline or dataset, which means the model have only seen the 3D assets in the normalized scale with clean coords, so I don't understand how does the slat flow matching model achieves such robustness.
The following pictures are original generated result from trellis/ coords visualization without slat feature(demonstrating the noise coords)/ rescaled coords before stage 2 generation.

Image Image Image

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named. Trace the slat flow matching training data pipeline and dataset handling to determine whether scaling or noise augmentation is applied, then document the finding and the source of the model's observed robustness.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.