Akegarasu / Akegarasu/lora-scripts
新版在阿里云克隆后会各种兼容性报错
- Dominant language
- Python
- Stars
- 6.1k
- Forks
- 699
- PR merge metrics
- No merged PRs in 30d
Description
前几天还是好的,今天新开N个实例,配置了好久各种报错
包括不限于以下错误,
Successfully installed lycoris-lora-2.1.0.post3
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
22:37:20-506427 WARNING Package version not found: onnxruntime-gpu
22:37:20-507297 INFO uninstalling wrong onnxruntime version
Installing onnxruntime
Found existing installation: onnxruntime 1.15.0
Uninstalling onnxruntime-1.15.0:
Successfully uninstalled onnxruntime-1.15.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Installing onnxruntime
WARNING: Skipping onnxruntime-gpu as it is not installed.
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
22:37:21-362218 INFO installing onnxruntime
Installing onnxruntime
Looking in indexes: https://mirrors.cloud.aliyuncs.com/pypi/simple
DEPRECATION: The HTML index page being used (https://mirrors.cloud.aliyuncs.com/pypi/simple/onnxruntime/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at https://github.com/pypa/pip/issues/10825
Collecting onnxruntime==1.18.1
Downloading https://mirrors.cloud.aliyuncs.com/pypi/packages/04/da/cd671caf4231942c4f68bf0dc1a959303df91dfd0e1d55c556b924d8e68e/onnxruntime-1.18.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.8/6.8 MB 20.3 MB/s eta 0:00:00
Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (1.12)
Requirement already satisfied: coloredlogs in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (15.0.1)
Requirement already satisfied: numpy<2.0,>=1.21.6 in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (1.23.5)
Requirement already satisfied: flatbuffers in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (23.5.26)
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (23.1)
Requirement already satisfied: protobuf in /usr/local/lib/python3.10/dist-packages (from onnxruntime==1.18.1) (3.19.6)
Requirement already satisfied: humanfriendly>=9.1 in /usr/local/lib/python3.10/dist-packages (from coloredlogs->onnxruntime==1.18.1) (10.0)
Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->onnxruntime==1.18.1) (1.3.0)
Installing collected packages: onnxruntime
Successfully installed onnxruntime-1.18.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Installing onnxruntime-gpu
Looking in indexes: https://mirrors.cloud.aliyuncs.com/pypi/simple
DEPRECATION: The HTML index page being used (https://mirrors.cloud.aliyuncs.com/pypi/simple/onnxruntime-gpu/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at https://github.com/pypa/pip/issues/10825
Collecting onnxruntime-gpu==1.18.1
Downloading https://mirrors.cloud.aliyuncs.com/pypi/packages/4d/52/fa9ba5a69cfed82ba1765882f50664b05c26982f55fec6edd1bda700195f/onnxruntime_gpu-1.18.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (200.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 200.8/200.8 MB 7.6 MB/s eta 0:00:00
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (23.1)
Requirement already satisfied: flatbuffers in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (23.5.26)
Requirement already satisfied: numpy<2.0,>=1.21.6 in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (1.23.5)
Requirement already satisfied: protobuf in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (3.19.6)
Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (1.12)
Requirement already satisfied: coloredlogs in /usr/local/lib/python3.10/dist-packages (from onnxruntime-gpu==1.18.1) (15.0.1)
Requirement already satisfied: humanfriendly>=9.1 in /usr/local/lib/python3.10/dist-packages (from coloredlogs->onnxruntime-gpu==1.18.1) (10.0)
Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->onnxruntime-gpu==1.18.1) (1.3.0)
Installing collected packages: onnxruntime-gpu
Successfully installed onnxruntime-gpu-1.18.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
22:37:40-634133 INFO SD-Trainer Version: v1.10.0-13-gb6d33fe
22:37:40-635090 INFO Starting tageditor...
22:37:40-635965 INFO Starting tensorboard...
22:37:40-656750 INFO Server started at http://127.0.0.1:28000
TensorFlow installation not found - running with reduced feature set.
NOTE: Using experimental fast data loading logic. To disable, pass
"--load_fast=false" and report issues on GitHub. More details:
https://github.com/tensorflow/tensorboard/issues/4784
22:37:41-718554 WARNING tkinter not found, file selector will not work.
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/usr/local/lib/python3.10/dist-packages/tensorboard/main.py", line 53, in
run_main()
File "/usr/local/lib/python3.10/dist-packages/tensorboard/main.py", line 46, in run_main
app.run(tensorboard.main, flags_parser=tensorboard.configure)
File "/usr/local/lib/python3.10/dist-packages/absl/app.py", line 308, in run
_run_main(main, args)
File "/usr/local/lib/python3.10/dist-packages/absl/app.py", line 254, in _run_main
sys.exit(main(argv))
File "/usr/local/lib/python3.10/dist-packages/tensorboard/program.py", line 276, in main
return runner(self.flags) or 0
File "/usr/local/lib/python3.10/dist-packages/tensorboard/program.py", line 292, in _run_serve_subcommand
server = self._make_server()
File "/usr/local/lib/python3.10/dist-packages/tensorboard/program.py", line 467, in _make_server
app = application.TensorBoardWSGIApp(
File "/usr/local/lib/python3.10/dist-packages/tensorboard/backend/application.py", line 140, in TensorBoardWSGIApp
return TensorBoardWSGI(
File "/usr/local/lib/python3.10/dist-packages/tensorboard/backend/application.py", line 253, in __init__
raise ValueError(
ValueError: Duplicate plugins for name projector
22:37:41-921897 INFO Loading config from
/mnt/workspace/lora-scripts/assets/config.json
22:37:41-923439 INFO Torch 2.0.1+cu117
22:37:41-942983 WARNING Torch version is lower than 2.3.0, which may not be
able to train FLUX model properly. Please re-run the
installation script (install.ps1 or install.bash) to
upgrade Torch.
22:37:41-944041 WARNING !!!Torch 版本低于 2.3.0,将无法正常训练 FLUX
模型。请考虑重新运行安装脚本以升级 Torch!!!
22:37:41-944870 WARNING !!!若您正在使用训练包,请直接下载最新训练包!!!
22:37:41-952822 INFO Torch backend: nVidia CUDA 11.7 cuDNN 8500
22:37:41-962115 INFO Torch detected GPU: NVIDIA A10 VRAM 22732 Arch (8, 6)
Cores 72 ‘
或者
Successfully installed protobuf-3.19.6 tensorboard-2.10.1 tensorboard-data-server-0.6.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
07:32:20-093176 INFO SD-Trainer Version: v1.10.0-12-g9e89bd2
07:32:20-094845 INFO Starting tageditor...
07:32:20-095947 INFO Starting tensorboard...
07:32:20-132440 INFO Server started at http://127.0.0.1:28000
WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
E0000 00:00:1732318340.892683 1257 cuda_dnn.cc:8310] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
E0000 00:00:1732318340.897006 1257 cuda_blas.cc:1418] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
TensorFlow installation not found - running with reduced feature set.
07:32:20-950509 INFO Loading config from /mnt/workspace/lora-scripts/assets/config.json
07:32:20-953171 INFO Torch 2.3.0+cu121
NOTE: Using experimental fast data loading logic. To disable, pass
"--load_fast=false" and report issues on GitHub. More details:
https://github.com/tensorflow/tensorboard/issues/4784
Address already in use
Port 6006 is in use by another program. Either identify and stop that program, or start the server with a different port.
07:32:21-739171 INFO Torch backend: nVidia CUDA 12.1 cuDNN 8902
07:32:21-747974 INFO Torch detected GPU: NVIDIA A10 VRAM 22732 Arch (8, 6) Cores 72
WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
E0000 00:00:1732318344.699063 1256 cuda_dnn.cc:8310] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
E0000 00:00:1732318344.703475 1256 cuda_blas.cc:1418] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1603, in _get_module
return importlib.import_module("." + module_name, self.__name__)
File "/usr/local/lib/python3.10/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/processing_auto.py", line 28, in
from ...image_processing_utils import ImageProcessingMixin
File "/usr/local/lib/python3.10/site-packages/transformers/image_processing_utils.py", line 21, in
from .image_transforms import center_crop, normalize, rescale
File "/usr/local/lib/python3.10/site-packages/transformers/image_transforms.py", line 49, in
import tensorflow as tf
File "/usr/local/lib/python3.10/site-packages/tensorflow/__init__.py", line 49, in
from tensorflow._api.v2 import __internal__
File "/usr/local/lib/python3.10/site-packages/tensorflow/_api/v2/__internal__/__init__.py", line 8, in
from tensorflow._api.v2.__internal__ import autograph
File "/usr/local/lib/python3.10/site-packages/tensorflow/_api/v2/__internal__/autograph/__init__.py", line 8, in
from tensorflow.python.autograph.core.ag_ctx import control_status_ctx # line: 34
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/autograph/core/ag_ctx.py", line 21, in
from tensorflow.python.autograph.utils import ag_logging
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/autograph/utils/__init__.py", line 17, in
from tensorflow.python.autograph.utils.context_managers import control_dependency_on_returns
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/autograph/utils/context_managers.py", line 19, in
from tensorflow.python.framework import ops
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/framework/ops.py", line 33, in
from tensorflow.core.framework import attr_value_pb2
File "/usr/local/lib/python3.10/site-packages/tensorflow/core/framework/attr_value_pb2.py", line 5, in
from google.protobuf.internal import builder as _builder
ImportError: cannot import name 'builder' from 'google.protobuf.internal' (/usr/local/lib/python3.10/site-packages/google/protobuf/internal/__init__.py)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/launch.py", line 101, in
import interface
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/interface.py", line 17, in
import tab_main, tab_settings, cmd_args, settings, utilities, logger, launch, paths
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/tab_main.py", line 9, in
from dte_instance import dte_instance
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dte_instance.py", line 1, in
import dataset_tag_editor as dte_module
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dataset_tag_editor/__init__.py", line 1, in
from . import tagger
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dataset_tag_editor/tagger.py", line 6, in
from .interrogators import WaifuDiffusionTagger, DepDanbooruTagger
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dataset_tag_editor/interrogators/__init__.py", line 3, in
from .git_large_captioning import GITLargeCaptioning
File "/mnt/workspace/lora-scripts/mikazuki/dataset-tag-editor/scripts/dataset_tag_editor/interrogators/git_large_captioning.py", line 1, in
from transformers import AutoProcessor, AutoModelForCausalLM
File "", line 1075, in _handle_fromlist
File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1594, in __getattr__
value = getattr(module, name)
File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1593, in __getattr__
module = self._get_module(self._class_to_module[name])
File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1605, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.models.auto.processing_auto because of the following error (look up to see its traceback):
cannot import name 'builder' from 'google.protobuf.internal' (/usr/local/lib/python3.10/site-packages/google/protobuf/internal/__init__.py)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.