microsoft / microsoft/promptflow
[Contribution Request] Align promptflow traces and metrics with OpenLLMetry
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 11.2k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
Is your contribution request related to a problem? Please describe.
I'm the maintainer of OpenLLMetry where we instrument LLM providers for traces and metrics on top of OpenTelemetry.
I'd like to align the way promptflow is reporting these metrics and traces by adopting the OpenLLMetry SDK here.
Detail the functionality and value.
Aligning semantic conventions for LLM traces and metrics which can then be supported by different observability platforms; additional frameworks, models and vector dbs instrumented.
Additional context
We're working with the otel community on making the attributes we defined the official semantic conventions, and I'm leading the LLM semantic conventions WG to do so.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.