jambonz / jambonz/v10-examples
web_search: agent not returning with web search results, prompts if user is still there
Nobody has claimed this yet.
- Dominant language
- JavaScript
- Stars
- 3
- Forks
- 2
- PR merge metrics
- No merged PRs in 30d
Description
While running the agent/web_search application, there are occasionally times when the agent makes the web search tool call, but then gets an instruction that the user has not responded, and does not come back with the results of the search. It looks like this may be caused by a transcription happening before the agent gets a response from the web search. The transcription has msg":"agent event: turn_end", but at this point, the agent still needs to respond with the web search results.
Example when the agent acts as if the user should have responded;
{"level":30,"time":1776474866905,"pid":34901,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"16acb357-ae8b-4e5b-b8e7-b884f0f45bb3","payload":{"type":"llm_response","response":"Hey there! Welcome, I'm your voice AI assistant, and I'm ready to help you out. I can answer questions, have a conversation, and yes, I can actually search the web in real time to get you the latest news, weather, sports scores, or pretty much anything else you need. So what's on your mind today?"},"msg":"agent event: llm_response"}{"level":30,"time":1776474884219,"pid":34901,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"16acb357-ae8b-4e5b-b8e7-b884f0f45bb3","payload":{"type":"user_transcript","transcript":"Can you tell mcde the latest news headlines?"},"msg":"agent event: user_transcript"}
{"level":30,"time":1776474885647,"pid":34901,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"16acb357-ae8b-4e5b-b8e7-b884f0f45bb3","name":"web_search","args":{"query":"latest news headlines today 2025"},"msg":"tool call"}{"level":30,"time":1776474887929,"pid":34901,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"16acb357-ae8b-4e5b-b8e7-b884f0f45bb3","payload":{"type":"llm_response","response":"Sure thing! Let me grab those for you right now."},"msg":"agent event: llm_response"}
{"level":30,"time":1776474887930,"pid":34901,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"16acb357-ae8b-4e5b-b8e7-b884f0f45bb3","payload":{"type":"turn_end","transcript":"Can you tell me the latest news headlines?","confidence":0.9980469,"response":"Sure thing! Let me grab those for you right now.","interrupted":false,"latency":{"stt_ms":401,"tool_ms":1227,"tts_ms":587},"tool_calls":[{"name":"web_search","rtt_ms":1227}]},"msg":"agent event: turn_end"}{"level":30,"time":1776474899908,"pid":34901,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"16acb357-ae8b-4e5b-b8e7-b884f0f45bb3","payload":{"type":"user_transcript","transcript":"(The user has not responded. Briefly check if they are still there or ask if they need help.)"},"msg":"agent event: user_transcript"}
Example when the web search returns before the transcription, and the call proceeds as expected:
{"level":30,"time":1776717026768,"pid":50953,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"eb0bf322-5173-44da-a74f-40e92bfe98dd","payload":{"type":"llm_response","response":"Hey there! Welcome, I'm your voice AI assistant. I'm here to chat, answer questions, and I can even search the web to pull up the latest information on just about anything. So whether you're curious about current events, need a quick fact check, or just want to have a conversation, I've got you covered. What's on your mind?"},"msg":"agent event: llm_response"}
{"level":30,"time":1776717047965,"pid":50953,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"eb0bf322-5173-44da-a74f-40e92bfe98dd","payload":{"type":"user_transcript","transcript":"Can you tell me the latest news headlines for today?"},"msg":"agent event: user_transcript"}
{"level":30,"time":1776717049502,"pid":50953,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"eb0bf322-5173-44da-a74f-40e92bfe98dd","name":"web_search","args":{"query":"latest news headlines today 2025"},"msg":"tool call"}
{"level":30,"time":1776717054647,"pid":50953,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"eb0bf322-5173-44da-a74f-40e92bfe98dd","payload":{"type":"llm_response","response":"Sure thing! Let me search for the latest headlines right now.Here are some of the top headlines making news today. In Shreveport, Louisiana, a gunman shot and killed eight children in what appears to be a domestic violence incident before police fatally shot him. That's a deeply tragic story. On the legal front, Kash Patel is suing The Atlantic for 250 million dollars, claiming a story about his drinking is false. In another development, the U.S. has seized an Iranian cargo ship. And prosecutors are moving to charge the artist known as D4vd with murder in connection with the death of a teenage girl. Those are some of the major stories right now. Would you like more details on any of these?"},"msg":"agent event: llm_response"}
{"level":30,"time":1776717072951,"pid":50953,"hostname":"Rhondas-MacBook-Pro-M4.local","call_sid":"eb0bf322-5173-44da-a74f-40e92bfe98dd","payload":{"type":"turn_end","transcript":"Can you tell me the latest news headlines for today?","confidence":1,"response":"Sure thing! Let me search for the latest headlines right now.Here are some of the top headlines making news today. In Shreveport, Louisiana, a gunman shot and killed eight children in what appears to be a domestic violence incident before police fatally shot him. That's a deeply tragic story. On the legal front, Kash Patel is suing The Atlantic for 250 million dollars, claiming a story about his drinking is false. In another development, the U.S. has seized an Iranian cargo ship. And prosecutors are moving to charge the artist known as D4vd with murder in connection with the death of a teenage girl. Those are some of the major stories right now. Would you like more details on any of these?","interrupted":false,"latency":{"stt_ms":601,"tool_ms":1422,"tts_ms":596},"tool_calls":[{"name":"web_search","rtt_ms":1422}]},"msg":"agent event: turn_end"}
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start in the agent/web_search application and compare the two provided event sequences, focusing on the ordering of the web_search tool call, turn_end, and user_transcript events. The fix is complete when a search result is processed before the agent treats the user as absent and the call continues with the returned results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript
- Domain
- backend
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100