lm-sys / lm-sys/FastChat

Invalid JSON Response Error When Running Langchain Use Cases with AutoGPT

Open
#1,847 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
39.5k
Forks
4.8k
PR merge metrics
No merged PRs in 30d

Description

I am having trouble while using the fastchat repo in combination with the openai_api_server and the TheBloke/Wizard-Vicuna-13B-Uncensored-HF worker model. Specifically, I'm encountering an error with an invalid response format when I try to run langchain use cases for Autonomous long running agent AutoGPT.

Here's the error message that I'm seeing:

Ensure the response can be parsed by Python json.loads
System: The current time and date is Tue Jul 4 01:43:08 2023
System: This reminds you of these events from your past:
["Assistant Reply: Sure, what would you like me to do next? \nResult: Error: {'error': 'Could not parse invalid json: Sure, what would you like me to do next?'}. "]

Human: Determine which next command to use, and respond using the format specified above:
AI: Sure, what would you like me to do next?
System: Error: {'error': 'Could not parse invalid json: Sure, what would you like me to do next?'}.
Human: Determine which next command to use, and respond using the format specified above:

This seems to suggest that the output from the AI ("Sure, what would you like me to do next?") is not being properly converted into JSON format and is causing the server to throw an error. I ensured that my setup and configurations were correctly implemented, but the issue still persists.

Any guidance or troubleshooting advice would be greatly appreciated. Thanks for your help!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the openai_api_server entry point and reproduce the AutoGPT Langchain use case with the TheBloke/Wizard-Vicuna-13B-Uncensored-HF worker model. Trace the response handling around the reported json.loads error; done means the server accepts or clearly reports the model response format without the invalid JSON failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, api
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.