elastic / elastic/elastic-otel-python-instrumentations

[OpenAI] Responses API support for Python

Open
#62 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
0
Forks
8
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**

The OpenAI platform just released an alternative to the completions endpoint called responses

https://platform.openai.com/docs/api-reference/responses

They are now using this by default in the playground (which generates content) as well as in their libraries like the OpenAI Agents SDK.

Soon, users will complain as they've been pushed into an endpoint that we don't have trace support for.

**Describe the solution you'd like**

Logs, metrics and tracing for responses like we do for completions.

*TODO* feature checkboxes

**Describe alternatives you've considered**

Tell people to not use responses

**Additional context**

announcement: https://community.openai.com/t/introducing-the-responses-api/1140929

local inference support of core features

- [x] litellm https://github.com/BerriAI/litellm/releases/tag/v1.67.0-stable
- [x] llama-stack https://github.com/meta-llama/llama-stack/releases/tag/v0.2.4
- [x] masaic-ai https://github.com/masaic-ai-platform/open-responses/releases/tag/v0.1.3-M2
- [ ] ollama https://github.com/ollama/ollama/issues/10309
- [ ] vllm https://github.com/vllm-project/vllm/issues/14721

other python SDKs
- [x] langtrace https://github.com/Scale3-Labs/langtrace-python-sdk/releases/tag/3.8.13
- [x] logfire https://github.com/pydantic/logfire/releases/tag/v3.8.0
- [x] openinference https://github.com/Arize-ai/openinference/releases/tag/python-openinference-instrumentation-openai-v0.1.26
- [x] openlit https://github.com/openlit/openlit/releases/tag/py-1.33.16
- [ ] openllmetry https://github.com/traceloop/openllmetry/pull/2787

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.