aimclub / aimclub/FEDOT

Image processing refactor

Abierto
#631 0 comentarios 0 reacciones 0 asignados Ver en GitHub
discuss enhancement refactoring
Lenguaje dominante
Python
Estrellas
712
Forks
96
Merge medio
3 d 1 h
PR fusionados (30 d)
10

Descripción

The alternative title for the future PR on this issue is "Batch-support implementation for image processing"

FEDOT currently has a separate DataTypesEnum.image data type. It loads all matrices into an array and then feeds some matrices in batches for CNN training. However, for most datasets with images, it is impossible to keep all matrices in RAM at the same time. Therefore, my suggestion is to create a new DataTypesEnum.image_paths data type, or modify an existing one.

The table will have something like the following structure
| **features** | **target** |
| :-----------------------------------------: | :--------: |
| D:/dataset\_name/train/first\_features.png | 1 |
| D:/dataset\_name/train/second\_features.png | 0 |

or the following structure for segmentation task for example:
| **features** | **target** |
| :-----------------------------------------: | :--------: |
| D:/dataset\_name/train/first\_features.png | D:/dataset\_name/train/first\_target.png |
| D:/dataset\_name/train/second\_features.png | D:/dataset\_name/train/second\_target.png |

Most likely, it is necessary to implement auxiliary classes that will load data into the neural network by parts (DataLoaders)

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.