huggingface / huggingface/candle
Error During Tokenizer Initialization When Deploying SD 3.5 Large Turbo
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
I’m encountering an issue while deploying the Stable Diffusion 3.5 Large Turbo model. The error occurs after about 67% of the model components are downloaded successfully, but it fails during the tokenizer initialization phase, causing the backend worker process to die unexpectedly. Has anyone experienced something similar or have any suggestions on how to troubleshoot or fix this?
Here are the libraries in use:
diffusers>=0.32.2
torchvision>=0.19.0
transformers>=4.43.2
accelerate>=0.34.0
safetensors>=0.4.3
torch>=2.4.0
pillow==11.1.0
sentencepiece==0.2.0
huggingface-hub[hf_transfer]==0.25.2
tokenizers==0.19.1
Thanks!
Contributor guide
No contributing guide indexed for this repository
Research direction
No source file, test, traceback, or Candle entry point is identified. Start by reproducing Stable Diffusion 3.5 Large Turbo deployment with the listed library versions and capture the tokenizer initialization and backend worker logs. Done means identifying a reproducible cause and documenting or fixing it with a regression test if the relevant code path is found.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- pytorch, rust
- Domain
- backend, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100