googleapis / googleapis/python-genai

The model speaking words like: "tool_outputs" during function-call with Gemini RealTime API

Open
#789 17 comments 2 reactions 1 assignee Claimed by @Venkaiahbabuneelam View on GitHub
api: gemini-api api: vertex-ai priority: p2 type: bug
Dominant language
Python
Stars
4k
Forks
1k
Avg merge
2d 11h
Merged PRs (30d)
40

Description

Hi Team, Good Day!

We are facing issues with function calling while using the gemini-live api. The agent sometimes says words like: "tools_output" and it is getting hallucinated.

#### Environment details

- Programming language: Python
- OS: mac
- Language runtime version: 3.9.6
- Package version: 1.14.0 (tried older builds till 1.12.0)

#### Steps to reproduce

1. Create a function - which returns some random responses in some time (say 4-5seconds)
2. Make the prompt which calls this function
3. The issue is intermittent - but trying with few sessions/function-calls its get reproduced.

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.