microsoft / microsoft/onnxruntime-inference-examples
[New Project] Inference of Stable-Diffisuion on All Platform with ONNXRuntime
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 1.7k
- Forks
- 414
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 14
Description
CppFast Diffusers Inference (CFDI)
CppFast Diffusers Inference (CFDI) is a C++ project. Its purpose is to leverage the acceleration capabilities of ONNXRuntime and the high compatibility of the .onnx model format to provide a convenient solution for the engineering deployment of Stable Diffusion.
You can find Project here: https://github.com/Windsander/CFDI-StableDiffusionONNXFast
The project aims to implement a high-performance SD inference library based on C/C++ using ONNXRuntime, comparable to HuggingFace Diffusers, with high model interchangeability.
Why choose ONNXRuntime as our Inference Engine?
-
Open Source: ONNXRuntime is an open-source project, allowing users to freely use and modify it to suit different application scenarios.
-
Scalability: It supports custom operators and optimizations, allowing for extensions and optimizations based on specific needs.
-
High Performance: ONNXRuntime is highly optimized to provide fast inference speeds, suitable for real-time applications.
-
Strong Compatibility: It supports model conversion from multiple deep learning frameworks (such as PyTorch, TensorFlow), making integration and deployment convenient.
-
Cross-Platform Support: ONNXRuntime supports multiple hardware platforms, including CPU, GPU, TPU, etc., enabling efficient execution on various devices.
-
Community and Enterprise Support: Developed and maintained by Microsoft, it has an active community and enterprise support, providing continuous updates and maintenance.
-
Below show What actually happened in [Example: 1-step img2img inference] in Latent Space (Skip All Models):

See Details on the Project Main Page
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points in this repository. Start by reviewing the linked CFDI-StableDiffusionONNXFast project and its main page, then determine whether a concrete ONNX Runtime inference example is intended here. Done would require a scoped change and acceptance criteria, which the issue does not provide.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100