cloudwego / cloudwego/eino

ollama创建模型时, 开启Thinking未生效,

Open
#969 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
13k
Forks
1.1k
Avg merge
4h 6m
Merged PRs (30d)
41

Description

embed "github.com/cloudwego/eino-ext/components/embedding/ollama"
"github.com/cloudwego/eino-ext/components/model/ollama"

func (widget *WidgetChat) GetChatModel(ctx context.Context, model string) (*ollama.ChatModel, error) {
return ollama.NewChatModel(ctx, &ollama.ChatModelConfig{
BaseURL: tarot.App.Business.Ollama.Address,
Model: model,
Thinking: &api.ThinkValue{Value: true},
})
}

配置了Thinking, 前端sse请求, 没有标签

Contributor guide

Open the contributing guide

Research direction

Start with the ollama.NewChatModel call and its ChatModelConfig Thinking option, then trace how the model response is passed through the frontend SSE request. Reproduce the shown configuration with an Ollama model that supports thinking and verify whether the stream preserves the thinking markers; done means the expected tags are available to the frontend when thinking is enabled.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, ollama
Domain
ai, backend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.