PipedreamHQ / PipedreamHQ/pipedream

[Components] guardrails

Open
#16,936 0 comments 0 reactions 0 assignees View on GitHub
triaged
Dominant language
JavaScript
Stars
11.7k
Forks
5.8k
Avg merge
3d 10h
Merged PRs (30d)
102

Description

# guardrails
## URLs
- https://docs.guardrails.io/docs/category/api
## Webhook Sources
### new-evaluation-instant
#### Description
Emit new event when a Guardrails evaluation (e.g., LLM output check) is completed. Requires configuration of project or endpoint to monitor.
### new-violation-instant
#### Description
Emit new event when an output fails a Guardrails validation or rule. Requires selection of project and optionally severity level to filter.
### new-feedback-submission-instant
#### Description
Emit new event when a user submits feedback on an evaluated LLM response. Requires configuration of project or workflow collecting feedback.
## Actions
### submit-evaluation
#### Description
Run a Guardrails evaluation on a given LLM output and return structured results. Requires prompt output and configuration of the desired evaluation schema.
### log-feedback
#### Description
Submit user feedback on a specific LLM evaluation result. Requires evaluation ID, feedback text, and optional metadata.
### create-evaluation-schema
#### Description
Create a new evaluation schema or rule set for validating LLM outputs. Requires schema configuration data and project association.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.