huggingface / huggingface/diffusers

Various Chroma pipeline issues

Aperta
#12,112 4 commenti 0 reazioni 0 assegnatari Vedi su GitHub
bug stale
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

### Describe the bug

Some minor issues that I have found while using the Chroma pipeline for the first time:

- if `sentencepiece` is not installed, you get a quite cryptic error message. Other pipelines such as Flux give you a nice error message that `sentencepiece` has to be installed
- `The config attributes {'guidance_embeds': False, 'pooled_projection_dim': 768} were passed to ChromaTransformer2DModel, but are not expected and will be ignored. Please verify your config.json configuration file.`
Chroma does not use CLIP, only T5, so there is no pooled projection. and does not use a guidance embedding as Flux - but I guess this is an issue with the config file, not the diffusers pipeline
- this code https://github.com/huggingface/diffusers/blob/03c3f69aa57a6cc2c995d41ea484195d719a240a/src/diffusers/pipelines/chroma/pipeline_chroma.py#L806 seems unnecessary, because dynamic timestep shifting is disabled in Chroma's scheduler config: https://huggingface.co/lodestones/Chroma1-HD/blob/main/scheduler/scheduler_config.json
confirmed by the actual timesteps that are used:
`(Pdb) timesteps
tensor([1000., 975., 950., 925., 900., 875., 850., 825., 800., 775.,
750., 725., 700., 675., 650., 625., 600., 575., 550., 525.,
500., 475., 450., 425., 400., 375., 350., 325., 300., 275.,
250., 225., 200., 175., 150., 125., 100., 75., 50., 25.],
device='cuda:0')`
- Chroma's official repo is `lodestones/Chroma1-HD` now. This could be updated in your pipeline example code: https://huggingface.co/docs/diffusers/main/api/pipelines/chroma

### Reproduction

run the sample code here https://huggingface.co/docs/diffusers/main/api/pipelines/chroma

### Logs

```shell

```

### System Info

diffusers HEAD, python 3.11.11

### Who can help?

_No response_

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

Start by running the Chroma sample from the pipeline documentation and inspect the referenced code in src/diffusers/pipelines/chroma/pipeline_chroma.py around line 806. Review each reported dependency, configuration-warning, scheduler, and example-model issue separately. Done means the listed problems are fixed or clearly confirmed as external configuration issues, with the Chroma example updated to the current repository.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python
Ambito
machine-learning
Tipo di issue
Bug
Difficoltà
4/5
Tempo stimato
3-5 giorni
Stato di attività
Ferma
Chiarezza
Abbastanza chiara
Idoneità per principianti
35/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.