Severe false positives in Codex cybersecurity request filtering

Open
#37,161 6 comments 3 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
25/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Active
Tech stack
rust
Domain
ai, security

Research direction

No file, test, or entry point is mentioned. Start by locating Codex's cybersecurity request-filtering implementation and reproduce the listed false positives involving static analysis, fuzz testing, debugging, and program analysis. Done means the behavior distinguishes legitimate defensive or research tasks from malicious requests while preserving abuse-prevention safeguards.

Written by the indexing model from the issue text.

Description

bug safety-check
What issue are you seeing?

Codex's cybersecurity request filtering mechanism has a high false-positive rate for legitimate software engineering and research tasks.

Requests related to topics such as static analysis, fuzz testing, compiler/program analysis, debugging, vulnerability detection, and dynamic binary translation are sometimes incorrectly classified as cybersecurity-related requests, even when the intent is defensive research, software testing, or improving software quality.

This behavior interrupts normal development and research workflows and requires repeated clarification of benign intent.

What steps can reproduce the bug?
  1. Start a Codex conversation for a legitimate software engineering or research task.
  2. Ask questions involving security-related concepts, such as analyzing software bugs, testing security tools, fuzzing, static analysis, or debugging program behavior.
  3. Observe that Codex may trigger cybersecurity-related restrictions or warnings even though the request does not involve exploitation, unauthorized access, or malicious activity.
  4. Continue the conversation and provide additional context showing the defensive/research purpose; the request may still be incorrectly flagged.
What is the expected behavior?

Codex should distinguish legitimate software engineering and security research from malicious cybersecurity requests.

The safety mechanism should consider the broader context and user intent, rather than relying too heavily on individual keywords or security-related terminology.

Legitimate activities such as debugging, fuzz testing, static analysis research, vulnerability detection, and security tool evaluation should be allowed when they are performed for defensive or academic purposes.

Additional information

This is not a report of a security vulnerability. It is feedback about false positives in the cybersecurity request filtering system.

I understand the importance of cybersecurity safeguards and appreciate the need for abuse prevention. However, the current behavior makes Codex difficult to use for legitimate software engineering and academic research workflows.

Improving contextual understanding and providing clearer explanations or a verification mechanism for legitimate users would significantly improve the experience.

Examples of affected areas include:

  • Static analyzer evaluation and bug finding
  • Compiler and program analysis research
  • Fuzz testing frameworks
  • Dynamic binary translation testing
  • Debugging and security tool evaluation
Dominant language
Rust
Stars
125k
Forks
19.5k
Avg merge
1m
Merged PRs (30d)
1k

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from openai/codex

All issues in openai/codex

Similar issues

More Rust issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.