Azure / Azure/azure-sdk-for-python

API Time Out

Open
#43,148 2 comments 0 reactions 1 assignee Claimed by @trrwilson View on GitHub
AI Agents Client customer-reported needs-team-attention question Service Attention
Dominant language
Python
Stars
5.6k
Forks
3.4k
Avg merge
1d 22h
Merged PRs (30d)
182

Description

- **Package Name**: azure-ai-agents==1.0.0
- **Package Version**: 1.0.0
- **Operating System**: python:3.13.1-alpine3.20
- **Python Version**: 3.13.1

**Describe the bug**
I have an application for agents serving around 10000 users. I works fine but recently we introduced another feature for connecting data-sources like Google Drive, Box etc to the agents vector store. every data source can have 100 files and the sync for any changes happen every night once.
After implementing this feature, we are facing this issue:

Content: Request to [https://eastus2.api.azureml.ms/agents/v1.0/subscriptions/d1c0578a-2aac-43e8-b6ce-71a955343806/resou…](https://eastus2.api.azureml.ms/agents/v1.0/subscriptions/d1c0578a-2aac-43e8-b6ce-71a955343806/resourceGroups/uchicago-its-genai-rg-dev/providers/Microsoft.MachineLearningServices/workspaces/uchicago-its-genai-aif-dev@uchicago-its-genai-aif-proj-dev@AML/threads/thread_dGR6UM41PquS1PjG3vLxfLbH/messages?api-version=v1) timed out

This is related to some time out, don't exactly know why is this happening but it is a random behavior, out of 100 calls at least 15 would give me this error.

**To Reproduce**
Steps to reproduce the behavior:
1. send 100 concurrent requests on any endpoint through SDK

**Expected behavior**
It should specify the error so we can capture and handle it gracefully, as in 429 etc. It can then be settled with retry and backoff

**Screenshots**
Dont have exact screen shot.

**Additional context**
NA

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.