How can I switch between LoRA models dynamically?

I have trained several LoRA models using the Flux model, and I want to switch between these LoRA models dynamically without reloading the base Flux model.

I saw in #1185 that the methods `backup_weights`, `pre_calculation`, and `restore_weights` can be used to achieve this, but there are no examples provided. Could you please share an example of how to use them in practice?

Start by reading issue #1185 and the references to `backup_weights`, `pre_calculation`, and `restore_weights`. Done means providing a practical example showing how to switch among trained LoRA models without reloading the base Flux model.

Written by the indexing model from the issue text.