invoke-ai / invoke-ai/InvokeAI

[enhancement]: Default to Flashpack for v7

Open
#9,548 2 comments 1 reaction 1 assignee Claimed by @Pfannkuchensack View on GitHub
enhancement
Dominant language
Python
Stars
28.2k
Forks
3k
Avg merge
6d 5h
Merged PRs (30d)
19

Description

### Is there an existing issue for this?

- [x] I have searched the existing issues

### Contact Details

_No response_

### What should this feature add?

[Flashpack](https://github.com/fal-ai/flashpack) is a high-throughput Diffusers-compatible weight storage format. It improves load times by between [3x and 20x](https://github.com/fal-ai/flashpack/blob/dc0e1fc8c6025dd0155a931f16e31829513ec2c0/README.md#production-numbers) versus Safetensors. It currently supports quantized Diffusers models and may add a single-file offline distribution option in the future (https://github.com/fal-ai/flashpack/pull/32).

You may wish to consider defaulting to Flashpack in version 7 and providing Flashpack versions of the various Starter Models, with SDNQ for quantization as required. This would potentially improve Invoke's time-to-first-generation speed considerably, particularly on lower-end systems where such enhancements are most important.

### Alternatives

_No response_

### Additional Content

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.