microsoft / microsoft/foundry-dev-tools

Foundry Local models from cache

Open
#301 4 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

needs attention
Dominant language
JavaScript
Stars
2.1k
Forks
260
Avg merge
42m
Merged PRs (30d)
29

Description

I have Foundry Local running, and trough the command line, you can see I have the model GPT-OSS in my cache and it is running.

Image Image

When I use github copilot, and I get to select models from Foundry Local (while using the AI Toolkit Extentions) I have also selected the GPT-OSS model, and it wants to start downloading it again, while it is already on my machine as you can see in the lists with cached models.

Image Image

Also the Azure AI Foundry extention when selecting a model from my Foundry Local installation, it keeps asking to download the model again. It seems that those plugins do look to a different cache directory, or perhaps do not make the API call to Foundry Local to find what models are already available in the cache.

Image

Something else I noticed as well, in VS Code I get to select the specific version of the model it needs to download, instead of harnessing the power of Foundry Local, to rely on the hardware detection of my machine.

Image

As you can see in the postman call to foundry local the models are available in the cache.

Is this a bug in Foundry Local or in the extention that is not using the same cache folder?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the GPT-OSS selection flow in VS Code through the AI Toolkit and Azure AI Foundry extensions, then compare it with the Postman request showing Foundry Local's cached models. Investigate whether the extensions use a different cache directory or omit the model-availability API call; done means an already cached model is recognized without another download.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, javascript, postman, vscode
Domain
ai, devtools
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.