Error when running frontend.py in demo2-multi-node-sharing: APIConnectionError

Hello,

I encountered an error when running the second demo in the repository. Following the README, I downloaded the image.

And I tried running frontend.py. However, I received the following error during execution:

File "/mnt/data1/user1/demo/demo2-multi-node-sharing/frontend.py", line 59, in <module>
    session = chat_session.ChatSession(PORT1)
File "/mnt/data1/user1/demo/demo2-multi-node-sharing/chat_session.py", line 21, in __init__
    models = client.models.list()
File "/mnt/data1/user1/anaconda3/envs/sglang/lib/python3.10/site-packages/openai/resources/models.py", line 91, in list
    return self._get_api_list(
File "/mnt/data1/user1/anaconda3/envs/sglang/lib/python3.10/site-packages/openai/_base_client.py", line 1326, in get_api_list
    return self._request_api_list(model, page, opts)
File "/mnt/data1/user1/anaconda3/envs/sglang/lib/python3.10/site-packages/openai/_base_client.py", line 1177, in _request_api_list
    return self.request(page, options, stream=False)
File "/mnt/data1/user1/anaconda3/envs/sglang/lib/python3.10/site-packages/openai/_base_client.py", line 954, in request
    return self._request(
File "/mnt/data1/user1/anaconda3/envs/sglang/lib/python3.10/site-packages/openai/_base_client.py", line 1014, in _request
    return self._retry_request(
File "/mnt/data1/user1/anaconda3/envs/sglang/lib/python3.10/site-packages/openai/_base_client.py", line 1092, in _retry_request
    return self._request(
File "/mnt/data1/user1/anaconda3/envs/sglang/lib/python3.10/site-packages/openai/_base_client.py", line 1024, in _request
    raise APIConnectionError(request=request) from err

However, based on the code, the wrapped OpenAI client is pointing to a local port service.

If you have any insights or suggestions on resolving this issue, I would appreciate it!

Thank you!

Start with the README instructions for demo2-multi-node-sharing, then inspect frontend.py around line 59 and chat_session.py around line 21. Verify that the local service is running and reachable at the configured PORT1 before rerunning frontend.py; done means the demo can initialize ChatSession without APIConnectionError.