modelscope / modelscope/DiffSynth-Studio

No match with original code and library!!!

Open
#967 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13.1k
Forks
1.3k
Avg merge
13h 12m
Merged PRs (30d)
45

Description

Traceback (most recent call last):
File "/home/QFRC/ZQS/Projects/BrainS/DiffSynth-Studio-main/examples/qwen_image/model_training/train_voxel.py", line 194, in
model = QwenImageTrainingModule(
File "/home/QFRC/ZQS/Projects/BrainS/DiffSynth-Studio-main/examples/qwen_image/model_training/train_voxel.py", line 66, in init
pipe = QwenImagePipeline.from_pretrained(
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/diffsynth/pipelines/qwen_image.py", line 331, in from_pretrained
model_manager.load_model(
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/diffsynth/models/model_manager.py", line 409, in load_model
model_names, models = model_detector.load(
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/diffsynth/models/model_manager.py", line 270, in load
loaded_model_names_, loaded_models_ = load_model_from_huggingface_folder(file_path, [model_name], [model_class], torch_dtype, device)
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/diffsynth/models/model_manager.py", line 86, in load_model_from_huggingface_folder
model = model_class.from_pretrained(file_path, torch_dtype=torch_dtype).eval()
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/diffsynth/models/qwenvl.py", line 36, in from_pretrained
return Qwen25VL_7b_Embedder(path, dtype=torch_dtype, device=device)
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/diffsynth/models/qwenvl.py", line 19, in init
self.processor = AutoProcessor.from_pretrained(
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/transformers/models/auto/processing_auto.py", line 385, in from_pretrained
return processor_class.from_pretrained(
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/transformers/processing_utils.py", line 1310, in from_pretrained
args = cls._get_arguments_from_pretrained(pretrained_model_name_or_path, **kwargs)
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/transformers/processing_utils.py", line 1369, in _get_arguments_from_pretrained
args.append(attribute_class.from_pretrained(pretrained_model_name_or_path, **kwargs))
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2013, in from_pretrained
return cls._from_pretrained(
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2051, in _from_pretrained
slow_tokenizer = (cls.slow_tokenizer_class)._from_pretrained(
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2259, in _from_pretrained
tokenizer = cls(*init_inputs, **init_kwargs)
File "/home/QFRC/ZQS/Anaconda/envs/qwen_env/lib/python3.10/site-packages/transformers/models/qwen2/tokenization_qwen2.py", line 172, in init
with open(vocab_file, encoding="utf-8") as vocab_handle:

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with examples/qwen_image/model_training/train_voxel.py, then follow the traceback through diffsynth/pipelines/qwen_image.py, diffsynth/models/model_manager.py, and diffsynth/models/qwenvl.py. Reproduce the failure at QwenImagePipeline.from_pretrained and inspect the AutoProcessor tokenizer-loading step. Done means identifying why the original code and installed library do not match and confirming that model initialization completes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.