kohya-ss / kohya-ss/sd-scripts

train_single_block_indices Parameter Appears Ineffective

Open
#1,970 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.2k
Forks
1.2k
Avg merge
11m
Merged PRs (30d)
2

Description

Command used:

accelerate launch --mixed_precision bf16 --num_cpu_threads_per_process 1 flux_train_network.py --pretrained_model_name_or_path "E:\0 - IA\ComfyUI2406\ComfyUI\models\unet\flux1-dev-fp8.safetensors" --clip_l "E:\0 - IA\ComfyUI2406\ComfyUI\models\clip\clip_l.safetensors" --t5xxl "E:\0 - IA\ComfyUI2406\ComfyUI\models\clip\t5xxl_fp8_e4m3fn.safetensors" --ae "E:\0 - IA\ComfyUI2406\ComfyUI\models\vae\ae.sft" --cache_latents_to_disk --save_model_as safetensors --sdpa --persistent_data_loader_workers --max_data_loader_n_workers 2 --seed 42 --gradient_checkpointing --mixed_precision bf16 --save_precision bf16 --network_module networks.lora_flux --network_dim 4 --network_train_unet_only --network_args "train_double_block_indices=none" "train_single_block_indices=7" --optimizer_type adamw8bit --learning_rate 1e-4 --cache_text_encoder_outputs --cache_text_encoder_outputs_to_disk --fp8_base --highvram --max_train_epochs 4 --save_every_n_epochs 1 --dataset_config "B:\kohya-ss\kohya_ss\sd-scripts\dataset_margot.toml" --output_dir "B:\kohya-ss\kohya_ss\sd-scripts\ouput" --output_name flux-lora-name --timestep_sampling shift --discrete_flow_shift 3.1582 --model_prediction_type raw --guidance_scale 1.0

Explanation Request:
- Why does specifying train_single_block_indices=7 not reduce training time compared to training all blocks?
- Could there be a conflict with train_double_block_indices=none or an issue in argument parsing?

Contributor guide

No contributing guide indexed for this repository

Research direction

No source files or tests are named. Start by reproducing the supplied accelerate command, then trace parsing of network_args for train_single_block_indices=7 and train_double_block_indices=none into Flux block selection. Done means explaining whether the selected block changes work or runtime and adding a regression test if the behavior is incorrect.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.