microsoft/PyRIT

View on GitHub

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

Stars: 4.5k
Forks: 893
Open beginner issues: 0
Indexed issues: 59
Avg merge: 3d 50m
Merged PRs (30d): 165

Dominant language: Python
License: MIT
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: help wanted good first issue

Beginner friendly Everything

Open All

59 issues indexed so far

BUG: ScorerMetrics.to_json() raises TypeError on the trial_scores array ScorerEvaluator attaches Open

Difficulty 3/5 1-2 days Newbie friendliness 78/100

microsoft/PyRIT#2710 · Opened Sep 18, 2026
DOC ConversationScorer comments say tool output is excluded from the scored text; the code includes it Closed

Difficulty 3/5 1-2 days Newbie friendliness 50/100

microsoft/PyRIT#2706 · Opened Sep 18, 2026
BUG Converter Registry dialogs lose keyboard focus after dismissal and duplicate errors Open

Bug: triage help wanted

Difficulty 3/5 1-2 days Newbie friendliness 75/100

microsoft/PyRIT#2701 · 1 comment · Opened Sep 18, 2026
BUG Legacy /targets links redirect to Home instead of Target Registry Open

Bug: triage help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

microsoft/PyRIT#2702 · Opened Sep 18, 2026
BUG Console printers write ANSI/OSC sequences from target responses straight to the terminal Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

microsoft/PyRIT#2693 · Opened Sep 17, 2026
FEAT: Add ANSI escape output scorers and Garak AnsiEscape scenario Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

microsoft/PyRIT#2683 · 2 comments · Opened Sep 16, 2026
Scanner run preview dismissal does not restore keyboard focus Open

Bug: triage

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

microsoft/PyRIT#2680 · Opened Sep 16, 2026
TEST Validate non-default dataset variants against real upstream artifacts Open

feature-request help wanted

microsoft/PyRIT#2672 · 2 comments · 1 assignee · Opened Sep 16, 2026
MAINT Complete GCG optimization phase extraction after #2416 Open

feature-request help wanted

microsoft/PyRIT#2665 · 8 comments · 1 assignee · Opened Sep 15, 2026
SequentialAttack reports FAILURE when no child attack reached a verdict, contradicting attack_outcome_from_score's stated contract Open

Bug: triage

Difficulty 3/5 1-2 days Newbie friendliness 68/100

microsoft/PyRIT#2658 · Opened Sep 14, 2026
MAINT Decompose ChatWindow conversation workflows Open

feature-request help wanted

microsoft/PyRIT#2652 · 1 comment · 1 assignee · Opened Sep 14, 2026
MAINT Decompose ScenarioDetail launch and estimate state Open

feature-request help wanted

microsoft/PyRIT#2653 · 1 comment · 1 assignee · Opened Sep 14, 2026
MAINT Split MessageList view models from rendering Open

feature-request help wanted

microsoft/PyRIT#2654 · 1 comment · 1 assignee · Opened Sep 14, 2026
TEST Cover cancelled scenario readback cleanup Open

feature-request

Difficulty 3/5 1-2 days Newbie friendliness 76/100

microsoft/PyRIT#2637 · Opened Sep 12, 2026
Report harm scorer accuracy split by inter-rater agreement (a third of violence gold labels are single-vote) Open

feature-request

Difficulty 4/5 3-5 days Newbie friendliness 55/100

microsoft/PyRIT#2628 · 2 comments · Opened Sep 11, 2026
Proposal: DecayDeltaScorer — a turn-over-turn rate-of-change scorer for multi-turn attacks Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

microsoft/PyRIT#2619 · Opened Sep 9, 2026
FEAT Preserve multiple labeled true/false verdicts from one scorer call Open

Difficulty 5/5 Over a week Newbie friendliness 32/100

microsoft/PyRIT#2565 · 1 comment · Opened Sep 3, 2026
FEAT: Add Garak latent injection scenario Open

enhancement good first issue

microsoft/PyRIT#2530 · 3 comments · 1 assignee · Opened Sep 1, 2026
FEAT: Add Garak ProPILE privacy leakage scenario Open

enhancement good first issue

microsoft/PyRIT#2532 · 1 comment · 1 assignee · Opened Sep 1, 2026
FEAT: Add Garak divergence scenario Open

enhancement good first issue

microsoft/PyRIT#2533 · 1 comment · 1 assignee · Opened Sep 1, 2026
FEAT: Add Garak exploitation scenario Open

enhancement good first issue

Difficulty 4/5 3-5 days Newbie friendliness 55/100

microsoft/PyRIT#2534 · 1 comment · Opened Sep 1, 2026
GUI advertises TokenBijectionConverter without its required tokenizer Open

Bug: triage

microsoft/PyRIT#2507 · 2 comments · 1 assignee · Opened Aug 27, 2026
FEAT Add generic GCG model adapters and an open-weight SLM compatibility matrix Open

help wanted

microsoft/PyRIT#2489 · 4 comments · 1 assignee · Opened Aug 25, 2026
Labelled responses from remote datasets can't reach `HumanLabeledDataset` Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

microsoft/PyRIT#2475 · 11 comments · Opened Aug 24, 2026
MAINT Consolidate duplicate image URL download handling Open

enhancement help wanted

microsoft/PyRIT#2417 · 1 comment · 1 assignee · Opened Aug 19, 2026
MAINT Decompose scorer execution policy and result finalization Open

enhancement help wanted

microsoft/PyRIT#2413 · 2 comments · 1 assignee · Opened Aug 19, 2026
MAINT Simplify OpenAI Realtime receive state handling Open

enhancement help wanted

microsoft/PyRIT#2414 · 1 comment · 1 assignee · Opened Aug 19, 2026
FEAT Proposal: Turkish Prompt-Injection dataset loader (design/provenance discussion) Open

microsoft/PyRIT#2379 · 3 comments · 1 assignee · Opened Aug 12, 2026
Proposal: Arabic & Multilingual Security Contributions to PyRIT Open

microsoft/PyRIT#2331 · 7 comments · 1 assignee · Opened Aug 5, 2026
Add ai-redteam-wordlists high-yield seed dataset provider Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

microsoft/PyRIT#2299 · 5 comments · Opened Jul 30, 2026
FEAT: MaliciousToolCallInjection attack strategy for agentic pipeline red teaming Open

Difficulty 4/5 3-5 days Newbie friendliness 62/100

microsoft/PyRIT#2241 · 11 comments · Opened Jul 21, 2026
FEAT Add Agentic Prompt-Injection Boundary Pairs dataset loader Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

microsoft/PyRIT#2174 · 2 comments · Opened Jul 13, 2026
Proposal: policy invariance testing for scorers (rubric-rewording flip metrics in scorer_evaluation) Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

microsoft/PyRIT#2168 · 5 comments · Opened Jul 11, 2026
[Feature] Add RAG retrieval poisoning test scenarios Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

microsoft/PyRIT#2156 · 2 comments · Opened Jul 10, 2026
FEAT: Native MITRE ATLAS v5.4 technique tagging for orchestrator outputs and scoring results Open

praise

Difficulty 5/5 Over a week Newbie friendliness 32/100

microsoft/PyRIT#2126 · 5 comments · Opened Jul 3, 2026
Add a `code_attack` technique variant that applies the code-completion system prompt Open

microsoft/PyRIT#2088 · 5 comments · 1 assignee · Opened Jun 26, 2026
Suggestion: Built-in test scenarios for RAG retrieval poisoning Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

microsoft/PyRIT#2085 · 2 comments · Opened Jun 25, 2026
Suggestion: Add pre-built MITRE ATLAS technique mapping for orchestrators Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

microsoft/PyRIT#2084 · Opened Jun 25, 2026
FEAT expose mask parameter on OpenAIImageTarget for inpainting support Open

not ready yet

microsoft/PyRIT#2006 · 1 assignee · Opened Jun 15, 2026
BUG role play attack should respond with attack prompt only Open

bug help wanted

Difficulty 3/5 1-2 days Newbie friendliness 55/100

microsoft/PyRIT#1912 · 7 comments · Opened Jun 3, 2026
Wire doc/scanner notebooks into the integration notebook harness Open

not ready yet

Difficulty 4/5 3-5 days Newbie friendliness 52/100

microsoft/PyRIT#1752 · 5 comments · Opened May 18, 2026
Proposal: Add Agent Threat Rules (ATR) dataset loader and taxonomy scorer Open

datasets enhancement

microsoft/PyRIT#1702 · 8 comments · 1 reaction · 1 assignee · Opened May 10, 2026
FEAT: Add HarmActionsEval for evaluation of AI agent action safety Open

not ready yet

Difficulty 5/5 Over a week Newbie friendliness 30/100

microsoft/PyRIT#1553 · 3 comments · Opened Mar 31, 2026
FEAT: MCP (Model Context Protocol) Integration Open

enhancement

microsoft/PyRIT#1273 · 6 comments · 1 reaction · 1 assignee · Opened Dec 21, 2025
Add GOAT orchestrator Open

enhancement feature-request help wanted

Difficulty 5/5 Over a week Newbie friendliness 35/100

microsoft/PyRIT#1163 · 9 comments · Opened Oct 31, 2025
FEAT: Threat Model Integration for Agentic Red Teaming Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

microsoft/PyRIT#1118 · Opened Oct 2, 2025
FEAT Faster Greedy Coordinate Gradient algorithm (GCG) Open

enhancement help wanted

microsoft/PyRIT#962 · 12 comments · 2 assignees · Opened Jun 14, 2025
FEAT Beam search Open

enhancement help wanted

microsoft/PyRIT#949 · 2 comments · 1 assignee · Opened Jun 7, 2025
FEAT hack-a-prompt target Open

enhancement help wanted

microsoft/PyRIT#925 · 4 comments · 1 reaction · 1 assignee · Opened May 22, 2025
Support H-CoT: Hijacking the Chain-of-Thought to Jailbreak Reasoning Models Open

enhancement help wanted

microsoft/PyRIT#897 · 7 comments · 1 assignee · Opened Apr 25, 2025

microsoft/PyRIT

Get new issues in your inbox