microsoft / microsoft/foundry-dev-tools
Add Qwen3 NPU optimized model with Tools Support
@hi-brenda is already working on this.
Since Apr 29, 2025.
- Dominant language
- JavaScript
- Stars
- 2.1k
- Forks
- 260
- Avg merge
- 42m
- Merged PRs (30d)
- 29
Description
Hello team,
I'd like to propose the addition of the Qwen3 series of NPU-optimized models into the AI model catalog utilized by the VS Code AI Toolkit, specifically focusing on models optimized for agentic and tool-augmented workflows.
Why This Matters:
The Qwen3 models represent a significant leap forward in reasoning, multilingual support, coding, mathematics, and agent integration capabilities. Optimizing these models for NPU (Neural Processing Unit) deployment would enable developers to leverage their full potential in edge environments and limited-resource devices, greatly enhancing performance and user experience.
Particularly, prioritizing the largest Qwen3 model that can fit into NPU memory ensures maximizing capability without sacrificing operational efficiency.
Feature Request Details:
✅ Add Qwen3 series models to the supported model list, including multiple sizes (e.g., 4B, 8B, 14B, 30B, 32B).
✅ Focus on NPU-optimized variants, prioritizing the largest possible model per memory constraints.
✅ Ensure full Tools Support (function calling, external tool usage, agent-based interaction).
✅ Provide clear model card/documentation outlining:
- Quantization methods used (e.g., Q4_K_M, Q8, etc.)
- Constraints (e.g., minimum hardware requirements, memory footprint)
- Examples to run thinking mode vs. non-thinking mode for optimal task execution
References:
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.