mlc-ai / mlc-ai/web-stable-diffusion

Demo fails on latest tvm/unity branch

Open
#17 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
3.7k
Forks
238
PR merge metrics
No merged PRs in 30d

Description

I'm currently going through the web-stable-diffusion demo, and I'm finding that the clip_to_text_embeddings function isn't adding functions to the exported IRModule, causing the assert to fail. This issue seems to have started appearing after March 20th, and I'm working to track down the isuse in the repo:

This seems to happen on MacOS and Linux. I haven't tried in Windows because PyTorch doesn't support compiled models on Windows yet.

I'm not sure if there's been an API change on TVM, or if this is a TVM bug or an issue with the demo.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the web-stable-diffusion demo and the clip_to_text_embeddings function on the latest tvm/unity branch. Compare the exported IRModule with the failing assertion and determine whether the cause is a TVM API change or a demo issue; done when the assertion passes on the reported MacOS and Linux setups.

Written by the indexing model from the issue text.

Assessment

Tech stack
pytorch
Domain
machine-learning, web-dev
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.