how to use a different optimizer?

There is an excellent example about how to use a different optimizer for a model trained from scratch. But, I am getting an error if I want to use a different optimizer for fine-tuning.

Start by reviewing the existing example for choosing an optimizer when training a model from scratch, then compare it with the fine-tuning setup that produces the error. Reproduce the failure and identify the missing details needed to define the expected behavior; done means fine-tuning supports the alternate optimizer or the documented limitation and usage are clear.

Written by the indexing model from the issue text.