Astrodevil / Astrodevil/ADK-Agent-Examples

Chat template is passed

Open
#6 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
47
Forks
9
PR merge metrics
No merged PRs in 30d

Description

when running Multi-tool-search agent,

Error code: 400 - {'detail': 'Invalid request. Please check the parameters and try again. Details: Chat template is passed with request, but
--trust-request-chat-template is not set. Refused request with untrusted chat template.'}

Investigation:
We intercepted the actual HTTP request being sent and confirmed that NO chat_template parameter is present in the request body. The request only contains:
{
"messages": [{"role": "user", "content": "..."}],
"model": "meta-llama/Meta-Llama-3.1-8B-Instruct"
}

Environment

- LiteLLM version: 1.80.0
- Google ADK (Agent Development Kit)
- Nebius API Base: https://api.studio.nebius.ai/v1
- Models tested:
- meta-llama/Meta-Llama-3.1-8B-Instruct
- meta-llama/Meta-Llama-3.1-8B-Instruct-fast

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.