microsoft / microsoft/PyRIT

FEAT: Threat Model Integration for Agentic Red Teaming

Open
#1,118 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
4.5k
Forks
893
Avg merge
3d 50m
Merged PRs (30d)
165

Description

Is your feature request related to a problem? Please describe.

When red teaming agentic systems with multiple tools, APIs, and permission boundaries, PyRIT lacks visibility into the system architecture. Understanding how agents interact with tools, what permissions they have, and how data flows through the system would enable more effective security testing.

Describe the solution you'd like

Enable PyRIT to leverage threat model information about agentic system architecture.

Threat model should capture:

  • Agent-to-tool relationships
  • Tool permissions and capabilities
  • Data flow paths
  • Component boundaries

Implementation could be:

  • Consume threat model files (JSON/YAML) from external tools
  • Run external threat modeling tools via subprocess
  • Native generation (if deemed valuable)
Additional context

Existing threat modeling tools for agentic systems:

Question:

  • Could target architecture simply be described in the adversarial agent's system prompt instead of structured files?
  • If structured threat models are preferred, what implementation approach fits best: consuming external files, subprocess integration, or native generation?
  • What tangible benefits would structured threat models provide over natural language architecture descriptions?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue does not identify repository files, tests, or entry points. First resolve whether PyRIT should consume structured JSON/YAML threat models, invoke external tools, or generate models natively; done would require an agreed architecture and implementation scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, security
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.