Invalid JSON Response Error When Running Langchain Use Cases with AutoGPT
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
I am having trouble while using the fastchat repo in combination with the openai_api_server and the TheBloke/Wizard-Vicuna-13B-Uncensored-HF worker model. Specifically, I'm encountering an error with an invalid response format when I try to run langchain use cases for Autonomous long running agent AutoGPT.
Here's the error message that I'm seeing:
Ensure the response can be parsed by Python json.loads
System: The current time and date is Tue Jul 4 01:43:08 2023
System: This reminds you of these events from your past:
["Assistant Reply: Sure, what would you like me to do next? \nResult: Error: {'error': 'Could not parse invalid json: Sure, what would you like me to do next?'}. "]Human: Determine which next command to use, and respond using the format specified above:
AI: Sure, what would you like me to do next?
System: Error: {'error': 'Could not parse invalid json: Sure, what would you like me to do next?'}.
Human: Determine which next command to use, and respond using the format specified above:
This seems to suggest that the output from the AI ("Sure, what would you like me to do next?") is not being properly converted into JSON format and is causing the server to throw an error. I ensured that my setup and configurations were correctly implemented, but the issue still persists.
Any guidance or troubleshooting advice would be greatly appreciated. Thanks for your help!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at the openai_api_server entry point and reproduce the AutoGPT Langchain use case with the TheBloke/Wizard-Vicuna-13B-Uncensored-HF worker model. Trace the response handling around the reported json.loads error; done means the server accepts or clearly reports the model response format without the invalid JSON failure.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, api
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100