open-telemetry / open-telemetry/opentelemetry-python-genai
[tracking] Conformance testing
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39
- Forks
- 63
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 175
Description
| Package | Status | Notes | Tracking |
|---|---|---|---|
| openai | partial | inference + tool_calling pass; embedding skipped; no streaming / Responses / structured-outputs scenarios | #38 |
| anthropic | partial | inference + tool_calling scenarios exist but both pytest.mark.skip'd for legacy gen_ai.system; tool_calling is single-turn |
#39, #40 |
| langchain | partial | inference + agent + workflow all pass; no tool-calling-outside-agent, streaming, or embeddings scenarios; only OpenAI provider exercised | |
| openai-agents | in-progress https://github.com/open-telemetry/opentelemetry-python-genai/pull/85 | empty conformance/ dir, no test_conformance.py, no tox factor; instrumentation has known semconv violations |
#86 |
| claude-agent-sdk | none | no conformance scaffold | |
| google-genai | none | no conformance scaffold | |
| weaviate-client | none | no conformance scaffold; semconv for vector-DB ops still upstream |
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Review the conformance status table and the listed instrumentation paths to understand the missing scenarios and scaffolds. Check pull request #85 and issues #38, #39, #40, and #86 before starting; the work is done when the relevant packages have the required conformance coverage and their table entries can be updated.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100