microsoft / microsoft/promptflow
[Feature Request] Support external Tracing Tools (e.g. langfuse)
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 11.2k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
Is your feature request related to a problem? Please describe.
I want to trace my whole prompt flow application with my existing langfuse solution. This functions of course well with the python tool, but not with e.g. the LLM and the Embedding Tool.
Describe the solution you'd like
It would be nice to use the existing prompt flow without just being able to use the Python Tool.
Describe alternatives you've considered
Only using the Python Tool and passing the trace id to every node in the graph
Additional context
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing how tracing currently works in the Python Tool and how the LLM and Embedding Tool entry points execute within a prompt flow. Define how an external tool such as langfuse would receive and propagate traces across those tools; done means an existing prompt flow can be traced without routing every node through the Python Tool.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- observability
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100