huggingface / huggingface/candle

Error During Tokenizer Initialization When Deploying SD 3.5 Large Turbo

Open
#2,827 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

I’m encountering an issue while deploying the Stable Diffusion 3.5 Large Turbo model. The error occurs after about 67% of the model components are downloaded successfully, but it fails during the tokenizer initialization phase, causing the backend worker process to die unexpectedly. Has anyone experienced something similar or have any suggestions on how to troubleshoot or fix this?

Here are the libraries in use:
diffusers>=0.32.2
torchvision>=0.19.0
transformers>=4.43.2
accelerate>=0.34.0
safetensors>=0.4.3
torch>=2.4.0
pillow==11.1.0
sentencepiece==0.2.0
huggingface-hub[hf_transfer]==0.25.2
tokenizers==0.19.1

Thanks!

Contributor guide

No contributing guide indexed for this repository

Research direction

No source file, test, traceback, or Candle entry point is identified. Start by reproducing Stable Diffusion 3.5 Large Turbo deployment with the listed library versions and capture the tokenizer initialization and backend worker logs. Done means identifying a reproducible cause and documenting or fixing it with a regression test if the relevant code path is found.

Written by the indexing model from the issue text.

Assessment

Tech stack
pytorch, rust
Domain
backend, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.