Updating `devtools_options.yaml` or `pubspec.yaml` doesn't update the extensions

If we edit `devtools_options.yaml` to enable/disable the extensions, it only seems to reload them by restarting the server. Also, removing the package from dependencies doesn't seem to update anything either. Maybe I'm doing something wrong but I could not make it update devtools.