microsoft / microsoft/promptflow

[Feature Request] Get the input of chat/prompt of LLM node

Open
#1,012 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement long-term
Dominant language
Python
Stars
11.2k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Description

Is your feature request related to a problem? Please describe.
Want to record the prompt and LLM settings for different runs in my DB. However, found promptflow didn't support any hooks in LLM node to retrieve the input before running or method to retrieve complete prompt after running.

Describe the solution you'd like
A hook before running LLM node or a method to retrive the prompt after running

Describe alternatives you've considered
Make custom tool to connect LLM? or formulate prompt before input to LLM node. For this, i need to give up using those useful features such as variants.

Additional context
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the LLM node execution path and how its prompt and settings are assembled. Determine whether a pre-run hook or post-run method should expose the complete prompt and settings, then consider how the API must behave with variants and recording data for different runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.