microsoft / microsoft/promptflow

[Feature Request] Have option to return trace as part of out put of a PromptFlow when deployed as endpoint

Open
#3,528 12 comments 1 reaction 1 assignee View on GitHub

@zhengfeiwang is already working on this.

Since Jul 10, 2024.

enhancement long-term no-recent-activity promptflow-core promptflow-tracing
Dominant language
Python
Stars
11.2k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Description

Is your feature request related to a problem? Please describe.
I want instant feedback after running a deployed prompt so I can put it in my database.

I currently need to keep polling for the azure insights to find the data I want so I need a background job to update the table.

Describe the solution you'd like
Make it possible to output the trace as part of the endpoint response. This way when I get the results I also have the telemetry so I can apply to tables along with results.

Describe alternatives you've considered
I have created a background worker to keep polling the azure insights for the prompt event which adds unnecessary complexity. It would be much easier if I can get the data immediately.

Additional context
This is a deployed endpoint.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.