Azure / Azure/azure-rest-api-specs

[Question] When Azure will sync OpenAI ChatCompletion stream_options feature ?

Open
#29,157 32 comments 31 reactions 1 assignee Claimed by @YunsongB View on GitHub
customer-reported data-plane question
Dominant language
TypeSpec
Stars
3.1k
Forks
5.9k
Avg merge
2d 22h
Merged PRs (30d)
444

Description

### API Spec link

https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference/preview/2024-04-01-preview/inference.json

### API Spec version

2024-04-01-preview

### Question/Query

OpenAI ChatCompletion API has add stream_options {include_usage} for stream get usage, it will help developer to statistics the api cost, it's very good for us, so when azure will sync it?

### Environment

REST API invoke it

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.