microsoft / microsoft/winml-cli

[Task] image-to-3d model support

Open
#291 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

model / task scale P2 triaged
Dominant language
Python
Stars
40
Forks
11
Avg merge
1d 8h
Merged PRs (30d)
50

Description

Overview

Image-to-3D models generate a 3D representation (mesh, NeRF, or structured latent) from a single input image. TRELLIS uses a structured latent representation (SLAT) and a powerful diffusion backbone, supporting both image and text conditioning and outputting high-quality meshes, radiance fields, and Gaussian splats.

Agent Scenarios

  • E-commerce product agent: convert a product photo into a 3D model for AR try-on or 360° viewing directly on Windows
  • Game asset creation agent: generate 3D props or characters from reference images for use in a game engine
  • Interior design agent: lift a photo of a furniture piece into a 3D object to place and visualize in a room layout
  • Digital twin agent: reconstruct physical objects from photos for simulation or inspection workflows

ModelKit Integration

Models must pass the full wmk pipeline on all EPs:

wmk config → wmk build (ONNX export) → wmk perf → wmk eval

Acceptance Criteria

  • microsoft/TRELLIS-image-large

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing existing model integrations and the ModelKit entry points used by wmk config, wmk build, wmk perf, and wmk eval. Determine how microsoft/TRELLIS-image-large should pass the full pipeline on all EPs. Done means the model is integrated and all four commands complete successfully across the supported EPs.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, tooling
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.