GPU memory loss (Loaders)

[Latest stable release --lowvram]
I can generate images indefinitely, until I start to change LoRA or models. After about 10 changes of LoRA or 5 changes of model I have not enough VRAM to generate images. It ends with an error message. Maybe some of data are kept in memory for optimization, but in -lowvram mode, all this needs to be cleaned up.