coze-dev / coze-dev/coze-loop

[BUG]For the source-deployed coze-loop using the Deepseek-v3 model to build an evaluator, an error occurs when using the evaluator.

Open
#257 4 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Go
Stars
5.7k
Forks
795
Avg merge
1d 4h
Merged PRs (30d)
29

Description

### 📋 CheckList

- [x] I have searched existing issues to avoid duplicates
- [x] I am using a recently maintained version of Coze Loop
- [x] I have provided all required information
- [x] I understand this is a bug report and not a feature request
- [x] I have submitted this report in English (otherwise it will not be processed)

### 🐛 Bug Description

When creating an evaluator, clicking 'Debug' sometimes returns a normal response, but sometimes displays an error: 'Invalid model output.
When testing with this evaluator, checking the call trace also shows 'Invalid model output.
On the official website, using the web version to build prompts and evaluators in the same way does not result in errors.

Question: Does the official Doubao model's evaluator output have a fixed format requirement? If so, what is this format?
Additionally, must the evaluator be built exclusively with the Doubao model? Are other models incompatible (e.g., a locally deployed coze-loop)?

### 🔄 Steps to Reproduce

1. Using source-deployed coze-loop
2. Employing locally hosted DS-v3 model
3. When constructing the evaluator and clicking debug, intermittent model output errors occur during multiple runs

### ✅ Expected Behavior

no error

### ❌ Actual Behavior

invalid output from model,code=601205015 message=invalid output from model

### 🚨 Severity

None

### 🔧 Component

None

### 💻 Environment

_No response_

### 🔧 Go Environment

_No response_

### 📋 Logs

```shell

```

### 📝 Additional Context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.