ProjectTech4DevAI / ProjectTech4DevAI/kaapi-guardrails

Callback Enhancement: Include intermediate responses

Open
#158 0 comments 0 reactions 1 assignee View on GitHub

@Prajna1999 is already working on this.

Since Sep 9, 2026.

Dominant language
Python
Stars
5
Forks
3
Avg merge
9d 13h
Merged PRs (30d)
2

Description

Is your feature request related to a problem?
The current callback response only includes the final provider response, leaving out crucial intermediate inputs and validation results, which limits visibility into the API's processing steps.

Describe the solution you'd like
Enhance the callback response to include:

  • User’s input (post-input guardrail)
  • Input to LLM (after input guardrail)
  • Output from LLM
  • Response to user (after output guardrail)
Original issue

Which feature or component needs enhancement?

The current callback response only contains the final provider response, omitting important intermediate inputs and validation results. This limits visibility into the API's processing steps and effectiveness.

Describe the current behavior
Post guardrails validation, we only send the final output response, but skip intermediate results i.e input to validators, input to llm, output from llm and post output guardrails response to user.

Describe the enhancement you'd like
Enhance the callback response (post guardrails) to include:

User’s input (post-input guardrail)
Input to LLM (after input guardrail)
Output from LLM
response to user(after output guardrail)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.