traceloop / traceloop/openllmetry
🚀 Feature: Associating Entities with Metrics
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 7.4k
- Forks
- 1.1k
- Avg merge
- 8d 14h
- Merged PRs (30d)
- 2
Description
Which component is this feature for?
LangChain Azure OpenAI Instrumentation, But ideally for all component.
🔖 Feature description
Similar to what we are doing for https://www.traceloop.com/docs/openllmetry/tracing/association, can we also set this to metrics? This will help understand LLM metrics better per entity that we want to track.
Particularly, I am interesting in Langchain metrics with Azure OpenAI.
🎤 Why is this feature needed ?
Helps associate Entities with Metrics which is useful to drill down metrics by Entity.
✌️ How do you aim to achieve this?
When we call Traceloop.set_association_properties we can propagate these to metric attributes as well along with traces.
🔄️ Additional Information
No response
👀 Have you spent some time to check if this feature request has been raised before?
- I checked and didn't find similar issue
Are you willing to submit PR?
None
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the implementation of Traceloop.set_association_properties and the metric instrumentation used for LangChain metrics with Azure OpenAI. Confirm how association properties reach traces, then define and test their propagation to metric attributes so metrics can be filtered by entity.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, python
- Domain
- observability
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100