ollama创建模型时, 开启Thinking未生效,
- Dominant language
- Go
- Stars
- 13k
- Forks
- 1.1k
- Avg merge
- 4h 6m
- Merged PRs (30d)
- 41
Description
embed "github.com/cloudwego/eino-ext/components/embedding/ollama"
"github.com/cloudwego/eino-ext/components/model/ollama"
func (widget *WidgetChat) GetChatModel(ctx context.Context, model string) (*ollama.ChatModel, error) {
return ollama.NewChatModel(ctx, &ollama.ChatModelConfig{
BaseURL: tarot.App.Business.Ollama.Address,
Model: model,
Thinking: &api.ThinkValue{Value: true},
})
}
配置了Thinking, 前端sse请求, 没有标签
Contributor guide
Research direction
Start with the ollama.NewChatModel call and its ChatModelConfig Thinking option, then trace how the model response is passed through the frontend SSE request. Reproduce the shown configuration with an Ollama model that supports thinking and verify whether the stream preserves the thinking markers; done means the expected tags are available to the frontend when thinking is enabled.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, ollama
- Domain
- ai, backend
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100