Unable to retrieve the updated configuration from the debug endpoint with the watcher flag enabled.

Description :

• While running a custom build of red-panda-connect with the watcher flag enabled in debug mode and trying to retrieve the latest configuration from the debug endpoint.
• The documentation (REF) states that the following endpoints should provide the current configuration:
  • /debug/config/json returns the configuration in JSON format
  • /debug/config/yaml returns the configuration in YAML format

However, after updating the configuration file, these endpoints still return the older configuration Instead It Should Return the latest configuration which red-panda-connect is using.

How To Reporduce

• create one config.json file. (you can use yaml as well)

   "http":{
       "enabled": true,
       "address": "0.0.0.0:4195",
       "root_path": "/benthos",
       "debug_endpoints": true
   },
 "input": {
   "generate": {
     "count": 100,
     "mapping": "root = \"hello\""
   }
 },
 "output": {
   "stdout": {
     "codec": "lines"
   }
 },
 "pipeline": {
   "processors": [
     {
       "mapping": "root.data = \"xyzza\"\n root.abc = \"abcd\""
     }
   ]
 }
}

• Run rpk file with this command rpk connect run -c temp.json --w
• Execute Below curl command

curl --location 'http://0.0.0.0:4195/benthos/debug/config/json

• Now done some change in above mentioned file
• Re run the above curl command

Expectation

• When the user executes the curl command a second time, it should return the latest configuration. However, it is currently returning the older configuration.

Start by reproducing the issue with rpk connect run -c temp.json --w and the /debug/config/json or /debug/config/yaml endpoints. Trace how the watcher reloads the configuration and how the debug endpoint reads it. Done means both endpoints return the latest configuration after the file changes.