Facing error when running API
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
I've been using a modified AutoGPT which can define a custom openai_base_url. (The repo is https://github.com/DGdev91/Auto-GPT). However, when I set the base url to localhost:8000, which is the same as fastchat API, I get the following error.
This the error on the AutoGPT side:
`openai.error.APIError: Invalid response object from API: 'Internal Server Error' (HTTP response code was 500)`
This is the error on the API side:
```
File "/home/rm2022/anaconda3/envs/llama/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ReadTimeout
```
I am wondering why this issue is caused and how to fix it. It would be better if I could keep the AutoGPT unchanged.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the request from the modified AutoGPT with openai_base_url set to localhost:8000, using the FastChat API entry point described in the report. Inspect the HTTPX ReadTimeout and the resulting HTTP 500 response to determine whether the API and client request are compatible. Done means identifying the cause and documenting or implementing a fix that allows AutoGPT to remain unchanged.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, backend
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100