ChatGPTNextWeb / ChatGPTNextWeb/NextChat

[Bug] Consistent: invalid_request_error - Anthropic API

Open
#4,964 2 comments 0 reactions 1 assignee Claimed by @Dogtiti View on GitHub
bug
Dominant language
TypeScript
Stars
88.8k
Forks
59.1k
PR merge metrics
No merged PRs in 30d

Description

### Bug Description

Claude 3.5 chats/API _were_ working, then I encountered what I presumed was a cache corruption issue with NC, so I reset, restarted and NC worked again.

After restarting NC anthropic API did not work, soI got a new API, pasted it, and this recurring error:

```
{
"type": "error",
"error": {
"type": "invalid_request_error",
"message": "max_tokens: 10000 > 4096, which is the maximum allowed number of output tokens for claude-3-5-sonnet-20240620"
}
}
```
As per Anthropic docs:

400 - invalid_request_error: There was an issue with the format or content of your request. We may also use this error type for other 4XX status codes not listed below.

### Steps to Reproduce

1. Paste new API in "model provider/Anthropic" .
2. Attempt Claude 3.5 chat
3. Error as above

### Expected Behavior

Claude 3.5, chats work.

### Screenshots

_No response_

### Deployment Method

- [ ] Docker
- [ ] Vercel
- [ ] Server

### Desktop OS

macOS m1 14.5

### Desktop Browser

_No response_

### Desktop Browser Version

2.12.4

### Smartphone Device

_No response_

### Smartphone OS

_No response_

### Smartphone Browser

_No response_

### Smartphone Browser Version

_No response_

### Additional Logs

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.