kohya-ss / kohya-ss/sd-scripts

[feature request]: Recursive loading of image folder

Open
#1,760 4 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.2k
Forks
1.2k
Avg merge
11m
Merged PRs (30d)
2

Description

Could you add an option for recursive loading of image files, with any number of layers? So you can sort more then just having multiple folders?

So rather then
```
1_Character 1
1_Character 2
1_Character 3
1_Character 4
1_Character 5
```

You can have
```
Series 1
Character 1
1_Outfit 1
1_Outfit 2
1_Character 2
Series 2
1_Character 1
Character 2
1_Outfit 1
1_Outfit 2
1_Character 3
```
Currently what i'm doing is prefixing the series or another tag to the beginning of the folder name, but it gets very cluttery with thousands of folders, yes im trying to train a Checkpoint.
```
1_Series 1 Character 1 Outfit 1
1_Series 1 Character 1 Outfit 2
1_Series 1 Character 2
1_Series 2 Character 1
1_Series 2 Character 2 Outfit 1
1_Series 2 Character 2 Outfit 2
1_Series 2 Character 3
```

But it has gotten so cluttery i am now thinking of using SymLinks as a temporary solution. So i can have one structured folder and then the unstructured training folder with SymLinks.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files or tests. Start by locating the image-folder loading entry point used for checkpoint training and trace how folder names become training data; verify the behavior with nested folders of arbitrary depth and confirm existing flat-folder loading still works.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.