microsoft / microsoft/promptflow
[Feature Request] Traicing tool for inference
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 11.2k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
Is your feature request related to a problem? Please describe.
We now have good tracing capabilities in VS Code Extension.
But it is not recorded in the output service (as I understand, but I could be wrong).
Describe the solution you'd like
It will be very cool if we can get traces from some inference endpoint and check them with a tracing tool (like LangSmith).
Or we can download the logs from the endpoint via some REST function and check them in the VSCode Extension - this could also be very useful (possibly back-end integration without having to download anything manually).
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the VS Code Extension's existing tracing capabilities and how inference endpoints connect to the output service. Compare the proposed LangSmith-style tracing flow with the alternative REST log-download flow; done should mean endpoint traces are accessible for inspection without manual log handling.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, vscode
- Domain
- ai, api, observability
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100