ProjectTech4DevAI / ProjectTech4DevAI/kaapi-guardrails
Validator: Improve Topic Relevance support
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 5
- Forks
- 3
- Avg merge
- 9d 13h
- Merged PRs (30d)
- 2
Description
Describe the current behavior
The frontend currently supports the Topic Relevance (LLM) validator, but there are a couple of backend limitations:
1. Configuration dropdown support
- The existing API used to fetch configurations for the Topic Relevance validator does not support the Topic Relevance (LLM) validator.
- When attempting to fetch configurations for Topic Relevance (LLM), the API returns a “validator not supported” error.
- As a result, users cannot select from existing configurations through a dropdown, unlike the standard Topic Relevance validator.
2. Create new configuration support
- The workflow for creating a new configuration is currently supported for the Topic Relevance validator only.
- Topic Relevance (LLM) configurations cannot be created, managed, or selected through the existing backend APIs.
Describe the enhancement you'd like
Add backend support for Topic Relevance (LLM) configuration management, including:
- Support fetching available configurations for the Topic Relevance (LLM) validator through the configuration API.
- Support creating new Topic Relevance (LLM) configurations.
- Support listing, retrieving, and managing Topic Relevance (LLM) configurations in the same way as the existing Topic Relevance validator.
- Ensure the APIs return data in a format compatible with the existing frontend configuration dropdown and creation workflows.
Additional context
The frontend implementation for the Guardrails UI updates assumes that Topic Relevance (LLM) behaves similarly to the existing Topic Relevance validator.
Current blockers observed:
- Fetching configurations for Topic Relevance (LLM) returns a “validator not supported” error.
- Creating new configurations for Topic Relevance (LLM) is not currently supported by the backend APIs.
The goal is to bring Topic Relevance (LLM) to feature parity with the existing Topic Relevance validator from a configuration management perspective.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the existing configuration API and creation workflow for the standard Topic Relevance validator, then locate where Topic Relevance (LLM) is rejected as unsupported. Compare the two validator paths and verify that fetching, creating, listing, retrieving, and managing LLM configurations return data compatible with the frontend workflows.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100