Azure-Samples / Azure-Samples/nlp-sql-in-a-box
Custom Template Azure Deploy
- Dominant language
- Python
- Stars
- 38
- Forks
- 19
- PR merge metrics
- No merged PRs in 30d
Description
The current implementation requires a quota increase for openAI or custom deployment fails. When we increase quota for deployment to foundry up to 30k TPM, we still get the following error:
{"code":"InvalidTemplateDeployment","details":[{"code":"InsufficientQuota","message":"This operation require 10 new capacity in quota Tokens Per Minute (thousands) - gpt-4o, which is bigger than the current available capacity 8. The current quota usage is 0 and the quota limit is 8 for quota Tokens Per Minute (thousands) - gpt-4o."}],"message":"The template deployment 'Microsoft.Template-20250129154614' is not valid according to the validation procedure. The tracking id is '42cb7a04-f063-40f9-9497-02463d122037'. See inner errors for details."}
We contacted Microsoft support on our standard support plan and had an OPENAI specialist look into this. They asked us to further increase quota on form, but that the current thresholds should work for this custom deployment.
Thank you for any feedback team!
Contributor guide
Assessment
This issue has not been assessed yet.