[REQUEST] GAN: Different learning rates and schedulers in one config for multiple .initialize() calls possible?

Hi, I'm using deepspeed to train a model that has a discriminator. I'm following the official GAN tutorial mostly (https://www.deepspeed.ai/tutorials/gan/)

Essentially I set up the model like this

model_engine, optimizer, _, _ = deepspeed.initialize(args=args, model = model, model_parameters=model.parameters(), optimizer=optimizer)
model_engine_adversary, optimizer_adversary, _, _ = deepspeed.initialize(args=args, model = adversarial_head, model_parameters=adversarial_head.parameters(), optimizer=optimizer_adversary)

And then start it with

deepspeed train.py  --deepspeed_config deepspeed_config.json

If I specify a scheduler in the json config as done in all tutorials, it applies to both model engines. Is there a way to specify two separate ones?

Start with the GAN tutorial and the two deepspeed.initialize calls shown in the issue, then inspect how deepspeed_config.json is applied to each engine. Determine whether one configuration can express separate learning rates and schedulers, and consider the behavior required for both model engines to use independent settings.