Azure-Samples / Azure-Samples/nlp-sql-in-a-box

Custom Template Azure Deploy

Open
#11 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
38
Forks
19
PR merge metrics
No merged PRs in 30d

Description

The current implementation requires a quota increase for openAI or custom deployment fails. When we increase quota for deployment to foundry up to 30k TPM, we still get the following error:

{"code":"InvalidTemplateDeployment","details":[{"code":"InsufficientQuota","message":"This operation require 10 new capacity in quota Tokens Per Minute (thousands) - gpt-4o, which is bigger than the current available capacity 8. The current quota usage is 0 and the quota limit is 8 for quota Tokens Per Minute (thousands) - gpt-4o."}],"message":"The template deployment 'Microsoft.Template-20250129154614' is not valid according to the validation procedure. The tracking id is '42cb7a04-f063-40f9-9497-02463d122037'. See inner errors for details."}

We contacted Microsoft support on our standard support plan and had an OPENAI specialist look into this. They asked us to further increase quota on form, but that the current thresholds should work for this custom deployment.

Thank you for any feedback team!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.