lllyasviel / lllyasviel/stable-diffusion-webui-forge
Working most of the day, then suddenly this: import error for "tokenizers". Now won't start, 5mins ago working.
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 13k
- Forks
- 1.7k
- PR merge metrics
- No merged PRs in 30d
Description
Hi
Was generating some XYZ plots to test various LORAs with Flux.
It was all going fine most of the day, then after a few grids, it started generating black frames. Had not restarted or anything, it had been running a while, then boom, black images. Hmm weird. OK I will shut it down and open up forge-webui again, maybe it needs memory cleared or something.
Now this, on startup:
```
Traceback (most recent call last):
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui-forge\launch.py", line 54, in
main()
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui-forge\launch.py", line 50, in main
start()
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui-forge\modules\launch_utils.py", line 546, in start
import webui
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui-forge\webui.py", line 17, in
initialize_forge()
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui-forge\modules_forge\initialization.py", line 95, in initialize_forge
modules_forge.patch_basic.patch_all_basics()
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui-forge\modules_forge\patch_basic.py", line 78, in patch_all_basics
from transformers.dynamic_module_utils import logger
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\transformers\__init__.py", line 26, in
from . import dependency_versions_check
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\transformers\dependency_versions_check.py", line 57, in
require_version_core(deps[pkg])
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\transformers\utils\versions.py", line 117, in require_version_core
return require_version(requirement, hint)
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\transformers\utils\versions.py", line 111, in require_version
_compare_versions(op, got_ver, want_ver, requirement, pkg, hint)
File "C:\AI\Image\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\transformers\utils\versions.py", line 44, in _compare_versions
raise ImportError(
ImportError: tokenizers>=0.19,<0.20 is required for a normal functioning of this module, but found tokenizers==0.13.3.
Try: `pip install transformers -U` or `pip install -e '.[dev]'` if you're working with git main
Press any key to continue . . .
```
I had NOT updated today, so why did it work part of the day... then start giving me this all of a sudden?
So I rebooted PC... same error.
PC, Win11, 4090 x 2.
Can't get into the UI but terminal tells me
**Version: f2.0.1v1.10.1-previous-480-g3b9b2f65
Commit hash: 3b9b2f653ef9579e871e73f34b3c5037395cc351**
Does this thing try to auto-update every time I run it? If so, how to turn that off? Can't be having 0-day problems all the time. Need something to run stable for a time then update when I choose. This makes no sense. I've not installed/updated ANYTHING today, nothing. So why was it working, then error?
Thanks
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with launch.py, modules/launch_utils.py, webui.py, modules_forge/initialization.py, and modules_forge/patch_basic.py, then trace the transformers import shown in the traceback. Determine why tokenizers==0.13.3 conflicts with the required transformers range and whether startup performs an update. Done means the reported startup failure and update behavior are explained or reproducibly addressed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- devtools, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100