microsoft / microsoft/foundry-dev-tools

Foundry Toolkit model catalog fails to load models after repeated /foundry/list calls trigger 429 TooManyRequests

Open
#431 4 comments 0 reactions 1 assignee View on GitHub

@xiaolang124 is already working on this.

Since Jun 9, 2026.

Dominant language
JavaScript
Stars
2.1k
Forks
260
Avg merge
42m
Merged PRs (30d)
29

Description

Summary

Foundry Toolkit for VS Code is unable to show models in the model catalog. Prompt/agent discovery works, but model discovery repeatedly hits 429 TooManyRequests / QuotaExceeded from both Azure Foundry catalog and GitHub model catalog APIs.

Environment

  • Product: Foundry Toolkit for VS Code
  • Extension version: 1.4.2
  • VS Code: VS Code Insiders
  • OS: Windows
  • Local service: Inference.Service.Agent.exe
  • Local API observed: http://localhost:5272/foundry/list
  • Azure Foundry catalog region in error: eastus2

Reproduction Steps

  1. Sign in to Azure from VS Code.
  2. Open Foundry Toolkit.
  3. Open or refresh the model catalog/model list.
  4. Observe that models do not appear correctly.
  5. Check Foundry Toolkit.log.

Expected Behavior

Foundry Toolkit should load the model catalog without repeatedly triggering throttling. If a catalog request is throttled, it should honor Retry-After, back off, and avoid duplicate concurrent refreshes.

Actual Behavior

Foundry Toolkit repeatedly calls the local /foundry/list endpoint, which then attempts to fetch model catalog data. The catalog calls are throttled with 429 TooManyRequests / QuotaExceeded, and models are not shown correctly.

Prompt/agent discovery appears to work, but model catalog discovery fails.

Error Details

Observed repeated errors in Foundry Toolkit.log:

Exception fetching models from Azure Foundry catalog
System.Exception: Failed: Fetching model list from Foundry Catalog
---> System.Net.Http.HttpRequestException: Received too many requests in a short amount of time. Retry again after 1 seconds.

"statusCode": 429
"code": "UserError"
"message": "Received too many requests in a short amount of time. Retry again after 1 seconds."
"innerError": {
  "code": "QuotaExceeded",
  "innerError": {
    "code": "TooManyRequests"
  }
}
Image

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.