open-telemetry / open-telemetry/opentelemetry-python-genai
opentelemetry-instrumentation-genai-llama-index gaps vs openinference instrumentation
Open
Nobody has claimed this yet.
openinference-migration
- Dominant language
- Python
- Stars
- 39
- Forks
- 63
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 175
Description
Ready to Fix
Missing Spans
- Add
AgentWorkflow.runspan (llama_index.core.agent.workflow.AgentWorkflow.run) - maps to GenAIinvoke_workflow(in progress in #495) - Add generic
Workflow.runspan (llama_index.core.workflow.Workflow.run) - maps to GenAIinvoke_workflow(#567) - Add retrieval span (
llama_index.core.base.base_retriever.BaseRetriever.retrieve/_retrieve,aretrieve/_aretrieve) - maps to GenAIretrieval(in progress in #502)
Missing Attributes & Features
None
Blocked on Semantic Conventions
Missing Spans
- Add generic workflow step span (
llama_index.core.workflow.Workflow@stepmethods /WorkflowStepOutputEvent) (https://github.com/open-telemetry/semantic-conventions-genai/issues/188) - Add reranker span (
ReRankStartEvent/ReRankEndEvent) (https://github.com/open-telemetry/semantic-conventions-genai/issues/253)
Missing Attributes & Features
- Capture reranker attributes (OpenInference:
reranker.query,reranker.model_name,reranker.top_k,reranker.input_documents,reranker.output_documents) (https://github.com/open-telemetry/semantic-conventions-genai/issues/253) - Capture document metadata in retrieval results (OpenInference:
document.metadata)
Gaps for Legacy APIs
- Add legacy agent spans (
llama_index.core.agent.runner.base.AgentRunner.chat/run_step,BaseAgent/BaseAgentWorker) - maps to GenAIinvoke_agent - Support legacy callback handler (
llama_index.core.global_handler/OpenInferenceTraceCallbackHandlerviause_legacy_callback_handler)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the listed LlamaIndex entry points, including AgentWorkflow.run, Workflow.run, BaseRetriever.retrieve/_retrieve and aretrieve/_aretrieve, plus the legacy agent APIs. Check the linked issues #495, #502, #567 and the semantic-convention blockers before choosing work; done means the applicable checklist gaps are implemented or explicitly resolved.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- observability
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 28/100