open-telemetry / open-telemetry/opentelemetry-python-genai
opentelemetry-instrumentation-genai-bedrock gaps vs openinference instrumentation
Open
Nobody has claimed this yet.
openinference-migration
- Dominant language
- Python
- Stars
- 39
- Forks
- 63
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 175
Description
Ready to Fix
Missing Spans
- Add
invoke_modelspan (botocore.client.BaseClient.invoke_model) - maps to GenAIchatortext_completion(in progress in #514) - Add
invoke_model_with_response_streamspan (botocore.client.BaseClient.invoke_model_with_response_stream) - maps to GenAIchatortext_completion(in progress in #514) - Add
invoke_agentspan (botocore.client.BaseClient.invoke_agentonbedrock-agent-runtime) - maps to GenAIinvoke_agent(#569) - Add
invoke_inline_agentspan (botocore.client.BaseClient.invoke_inline_agentonbedrock-agent-runtime) - maps to GenAIinvoke_agent(#570) - Add
retrievespan (botocore.client.BaseClient.retrieveonbedrock-agent-runtime) - maps to GenAIretrieval(#571)
Missing Attributes & Features
- Capture
guardrailConfigonchat(OpenInference:metadata.guardrailIdentifier, semconv:aws.bedrock.guardrail.id) (in progress in #514) - Support
aiobotocoreasync client instrumentation forchat(Converse,ConverseStream) (#572) - Capture buffered completion stream content on
invoke_agent(OpenInference:output.value, semconv:gen_ai.output.messages) (#573)
Blocked on Semantic Conventions
Missing Spans
- Add
apply_guardrailspan (botocore.client.BaseClient.apply_guardrail) (https://github.com/open-telemetry/semantic-conventions-genai/pull/427) - Add
retrieve_and_generatespan (botocore.client.BaseClient.retrieve_and_generateonbedrock-agent-runtime) - Add
retrieve_and_generate_streamspan (botocore.client.BaseClient.retrieve_and_generate_streamonbedrock-agent-runtime) - Add child spans for Bedrock Agent internal server traces (
orchestrationTrace,preProcessingTrace,postProcessingTrace,routingClassifierTrace,guardrailTrace)
Missing Attributes & Features
- Capture guardrail assessment results and actions on
apply_guardrail(OpenInference:metadata.action,metadata.actionReason) (https://github.com/open-telemetry/semantic-conventions-genai/pull/427) - Capture citations and references on
retrieve_and_generate(OpenInference:retrieval_documents)
Gaps for Legacy APIs
- Support legacy text completion model formats on
invoke_model(AI21 completions, Anthropic V1/V2 completions, Cohere generations, Meta generations, Titan output text) (OpenInference:llm.invocation_parameters,output.value) (in progress in #514)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by choosing one unblocked Ready to Fix item and inspect its named botocore entry point, such as invoke_agent, invoke_inline_agent, or retrieve. Check the related issues (#569–#573) and the work in progress in #514 before starting. Done means the selected gap is implemented and its checklist item can be marked complete without taking on the convention-blocked work.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- observability
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100