Azure / Azure/azure-sdk-for-python
API Time Out
- Dominant language
- Python
- Stars
- 5.6k
- Forks
- 3.4k
- Avg merge
- 1d 22h
- Merged PRs (30d)
- 182
Description
- **Package Name**: azure-ai-agents==1.0.0
- **Package Version**: 1.0.0
- **Operating System**: python:3.13.1-alpine3.20
- **Python Version**: 3.13.1
**Describe the bug**
I have an application for agents serving around 10000 users. I works fine but recently we introduced another feature for connecting data-sources like Google Drive, Box etc to the agents vector store. every data source can have 100 files and the sync for any changes happen every night once.
After implementing this feature, we are facing this issue:
Content: Request to [https://eastus2.api.azureml.ms/agents/v1.0/subscriptions/d1c0578a-2aac-43e8-b6ce-71a955343806/resou…](https://eastus2.api.azureml.ms/agents/v1.0/subscriptions/d1c0578a-2aac-43e8-b6ce-71a955343806/resourceGroups/uchicago-its-genai-rg-dev/providers/Microsoft.MachineLearningServices/workspaces/uchicago-its-genai-aif-dev@uchicago-its-genai-aif-proj-dev@AML/threads/thread_dGR6UM41PquS1PjG3vLxfLbH/messages?api-version=v1) timed out
This is related to some time out, don't exactly know why is this happening but it is a random behavior, out of 100 calls at least 15 would give me this error.
**To Reproduce**
Steps to reproduce the behavior:
1. send 100 concurrent requests on any endpoint through SDK
**Expected behavior**
It should specify the error so we can capture and handle it gracefully, as in 429 etc. It can then be settled with retry and backoff
**Screenshots**
Dont have exact screen shot.
**Additional context**
NA
Contributor guide
Assessment
This issue has not been assessed yet.