Azure / Azure/azure-rest-api-specs

[FEATURE REQ] Supporting `tools` in the Batch job requests

Open
#30,369 0 comments 1 reaction 0 assignees View on GitHub
customer-reported data-plane feature-request OpenAI question Service Attention
Dominant language
TypeSpec
Stars
3.1k
Forks
5.9k
Avg merge
2d 22h
Merged PRs (30d)
444

Description

### API Spec link

https://github.com/Azure/azure-rest-api-specs/blob/a3d10ee17c8f7ca4c2b4402862a1dc78fbab5c2a/specification/cognitiveservices/data-plane/AzureOpenAI/inference/stable/2024-06-01/inference.yaml

### API Spec version

2024-06-01

### Please describe the feature.

Hello,

Just a request to add support for the 'tool' in Batch job requests. This is supported by OpenAI API, so hopefully can also be supported by Azure. If there is a plan to introduce this, could you share the expected time it will become generally available?

Thank you!

Contributor guide

Open the contributing guide

Research direction

Start with the linked specification/cognitiveservices/data-plane/AzureOpenAI/inference/stable/2024-06-01/inference.yaml file and inspect the Batch job request definitions for the missing `tools` support. Compare the 2024-06-01 schema with the requested OpenAI API behavior; done means the Azure OpenAI inference specification represents tool-enabled Batch job requests.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, openapi
Domain
ai, api, cloud
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.