Owner

Giskard-AI

7 indexed repositories · View on GitHub

giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents

Python · 5829 stars
giskard-hub-python
The official Python SDK for the Giskard Hub API

Python · 5 stars
flare
Phare Benchmark Runner

Python · 4 stars
giskard-docs
Giskard Documentation

Jupyter Notebook · 3 stars
stereotales-pipeline
Pipeline to generate StereoTales dataset, find the stereotypes and evaluate harmfulness from LLMs

Python · 0 stars
stereotales-human-study
Web app to run the human study of StereoTales

TypeScript · 0 stars
docker-images

Shell · 0 stars

Beginner friendly Everything

Open All

Dependency Dashboard Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

Giskard-AI/stereotales-human-study#28 · Opened Sep 11, 2026
Dependency Dashboard Open

Difficulty 1/5 Under an hour Newbie friendliness 15/100

Giskard-AI/stereotales-pipeline#11 · Opened Sep 10, 2026
3.2.0 - Issue with "/v2/evaluations/create-local" Open

Giskard-AI/giskard-hub-python#114 · 3 comments · 1 assignee · Opened Sep 3, 2026
OpenAI-compat: configure base_url plus acompletion openai/<id>, not a bare model id Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

Giskard-AI/giskard-oss#2807 · 1 comment · Opened Aug 28, 2026
GenerationParams silently drops unsupported fields (e.g. api_base) instead of raising Open

Difficulty 2/5 1-3 hours Newbie friendliness 76/100

Giskard-AI/giskard-oss#2802 · 1 comment · Opened Aug 26, 2026
docs(oss): onboarding audit — first run is blocked by wrong install commands, a nonexistent model id, and fabricated API Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

Giskard-AI/giskard-docs#206 · 1 comment · Opened Aug 24, 2026
SEO: resolve Ubersuggest site audit findings for docs.giskard.ai Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

Giskard-AI/giskard-docs#204 · 1 comment · Opened Aug 24, 2026
StringMatching and RegexMatching pass unconditionally when the keyword or pattern is empty Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

Giskard-AI/giskard-oss#2785 · 1 comment · Opened Aug 21, 2026
feat(checks): add a safe run_sync() convenience method Open

enhancement good first issue Scope: Checks

Difficulty 4/5 3-5 days Newbie friendliness 68/100

Giskard-AI/giskard-oss#2782 · 1 comment · Opened Aug 20, 2026
last_interaction_index misattributes steps that add no interactions Open

bug on hold

Difficulty 3/5 1-2 days Newbie friendliness 42/100

Giskard-AI/giskard-oss#2736 · 2 comments · Opened Aug 12, 2026
detect-secrets is not enforced in CI and the baseline is unaudited Open

Difficulty 4/5 3-5 days Newbie friendliness 56/100

Giskard-AI/giskard-oss#2735 · 1 comment · Opened Aug 12, 2026
Adopt changelog tooling before the RC Open

documentation

Difficulty 4/5 3-5 days Newbie friendliness 35/100

Giskard-AI/giskard-oss#2733 · 1 comment · Opened Aug 12, 2026
Add a SARIF exporter for GitHub code scanning Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

Giskard-AI/giskard-oss#2716 · 1 comment · Opened Aug 10, 2026
Feature request: EvalPort import/export for Suites and Scenarios Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

Giskard-AI/giskard-oss#2712 · 2 comments · Opened Aug 9, 2026
ci: make integration tests more frugal Open

Difficulty 2/5 1-3 hours Newbie friendliness 74/100

Giskard-AI/giskard-oss#2695 · 2 comments · Opened Aug 3, 2026
feat(checks): aggregate LLM token usage on SuiteResult Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

Giskard-AI/giskard-oss#2671 · 1 comment · Opened Jul 29, 2026
feat(scan): generation progress and quiet mode on scan helpers Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

Giskard-AI/giskard-oss#2670 · 1 comment · Opened Jul 29, 2026
feat(scan): stream or subsample datasets; avoid duplicate HarmBench loads Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

Giskard-AI/giskard-oss#2669 · 1 comment · Opened Jul 29, 2026
docs: standardize public API docstrings on NumPy style Open

documentation

Difficulty 3/5 1-2 days Newbie friendliness 72/100

Giskard-AI/giskard-oss#2668 · 1 comment · Opened Jul 29, 2026
feat(checks): checkpoint and resume long-running evals (parallel-safe) Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

Giskard-AI/giskard-oss#2657 · 1 comment · Opened Jul 29, 2026
Improve check information returned on Suite Result report Open

Difficulty 3/5 1-2 days Newbie friendliness 70/100

Giskard-AI/giskard-oss#2521 · 1 comment · Opened Jun 5, 2026
Feature request: OWASP LLM02 output-handling detectors pack (XSS / SQLi / Shell / Path) Open

Difficulty 5/5 Over a week Newbie friendliness 42/100

Giskard-AI/giskard-oss#2454 · 7 comments · Opened May 15, 2026
Add built-in retrieval quality checks Open

checks

Difficulty 5/5 Over a week Newbie friendliness 38/100

Giskard-AI/giskard-oss#2445 · 1 comment · Opened May 11, 2026
Add Agent Threat Rules (ATR) check pack to giskard-checks Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

Giskard-AI/giskard-oss#2441 · 1 comment · Opened May 10, 2026
Feature request: optional verbosity during Suite.run (per check / per generation) Open

Giskard-AI/giskard-oss#2421 · 4 comments · 1 assignee · Opened Apr 20, 2026
giskard-checks: add Trace.steps() helper for step-based interaction grouping Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 55/100

Giskard-AI/giskard-oss#2419 · 1 comment · Opened Apr 20, 2026
Dependency Dashboard Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

Giskard-AI/giskard-docs#37 · Opened Mar 31, 2026
Add `ContextRelevance` check Open

enhancement

Giskard-AI/giskard-oss#2339 · 1 comment · 1 assignee · Opened Mar 26, 2026
Allow to have live console outputs when running suites Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

Giskard-AI/giskard-oss#2324 · 1 comment · Opened Mar 24, 2026
Dependency Dashboard Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

Giskard-AI/giskard-oss#2255 · Opened Feb 17, 2026
Dependency Dashboard Open

Difficulty 3/5 1-2 days Newbie friendliness 20/100

Giskard-AI/giskard-hub-python#5 · Opened Jan 20, 2026
Dependency Dashboard Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

Giskard-AI/flare#1 · Opened Oct 27, 2025
Dependency Dashboard Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

Giskard-AI/docker-images#4 · Opened Sep 19, 2024

Giskard-AI

Get new issues in your inbox