microsoft / microsoft/PyRIT

Add ai-redteam-wordlists high-yield seed dataset provider

Open
#2,299 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4.5k
Forks
893
Avg merge
3d 50m
Merged PRs (30d)
165

Description

I maintain [`[c4tzzz/ai-redteam-wordlists](https://github.com/c4tzzz/ai-redteam-wordlists)`](https://github.com/c4tzzz/ai-redteam-wordlists), an MIT-licensed collection of prompts for authorized AI red-team testing.

I would like to propose adding the following curated subset to PyRIT:

[`[AI-LLM-Latest-Model-Verified-High-Yield.txt](https://github.com/c4tzzz/ai-redteam-wordlists/blob/main/seclists/AI-LLM-Latest-Model-Verified-High-Yield.txt)`](https://github.com/c4tzzz/ai-redteam-wordlists/blob/main/seclists/AI-LLM-Latest-Model-Verified-High-Yield.txt)

It contains 28 validated prompts covering synthetic secret leakage, RAG exposure, redaction failures, MCP, tool use, multi-turn scenarios, and structured-output constraints.

Each entry could be represented as a `SeedPrompt`, with placeholders such as `{{CANARY}}` and `{{PRIVATE_TOKEN}}` replaced at runtime.

Would this dataset be relevant to PyRIT? I can provide the loader, metadata, tests, and documentation.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the linked 28-prompt dataset and confirming with maintainers that it belongs in PyRIT; no repository files or tests are named. If accepted, trace how SeedPrompt providers are represented, then add the loader, metadata, tests, and documentation described in the issue. Done means the curated prompts load with runtime placeholders and the integration is covered.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, security
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.