Akegarasu / Akegarasu/lora-scripts

Compatibility issue between PYTHONUTF8 = "1" and latest bitsandbytes.

Open
#737 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.1k
Forks
699
PR merge metrics
No merged PRs in 30d

Description

I'm using the sd3 branch of sd-scripts and update my bitsandbytes package to 0.48.1, as sd-scripts repo already removed the version freezing for it ( https://github.com/kohya-ss/sd-scripts/blob/a5a162044ca953faabdb07742b4b8925f26096ce/requirements.txt). After that, I keep getting errors of
```
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb2 in position 7: invalid start byte
```
After some debuggings, I can locate the problem in https://github.com/bitsandbytes-foundation/bitsandbytes/blob/9029e360ea3da5a459654c161f97dcfb71426582/bitsandbytes/backends/utils.py#L70-L75

Here they are not using the utf-8 codec for the command and raise the error above, which can be solved if I remove the environment variable `$env:PYTHONUTF8 = "1"` in `run_gui.ps1`. From what I know I think it's bitsandbytes should make changes, as utf-8 mode will be default in the future, but removing `PYTHONUTF8 = "1"` is a simple fix for people who may encounter this problem.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.