openai / openai/codex

Agent safeguard repeatedly flags ordinary dev automation as "possible cybersecurity risk," escalating to a full goal block on a long-running unattended task

Open
#39,090 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug iOS safety-check windows-os
Dominant language
Rust
Stars
125k
Forks
19.4k
PR merge metrics
PR metrics pending

Description

Environment

  • Codex mobile app (iOS)
  • An agent session running an unattended, multi-day automated software task (build/test/refactor work on a personal project), controlled remotely via the mobile app
  • No security research, exploit development, red-team activity, or credential-related work occurred in any of the flagged steps

What happened

Over a roughly 20-minute window in one continuous session, the same false-positive safety flag fired four separate times, each time immediately after entirely ordinary agent actions:

  • Running shell/PowerShell commands (routine build and test tooling)
  • Editing and creating project script and test files
  • Sending a status message to a sub-agent handling a separate bounded task
  • Agent reasoning text describing pipeline steps, internal gating/validation logic, and a fix to an orchestration bug — no security-relevant content, no credentials, no exploit code, no mention of any external target

Every one of the four occurrences produced the identical UI message:

"This content was flagged for possible cybersecurity risk. If this seems wrong, try rephrasing your request. To get authorized for security work, join the Trusted Access for Cyber program: https://chatgpt.com/cyber"

Impact — this is not just a warning

This is not a single false-positive notice that the user can shrug off. Across the four occurrences the session's own status indicator visibly degraded:

  • Pursuing goal (first two occurrences)
  • Queued (third occurrence, mid-response)
  • Goal blocked (fourth occurrence)

The safeguard did not just mis-flag benign automation — it accumulated across repeated ordinary tool calls until it halted a multi-day unattended background task. There was no in-session way to provide clarifying context, confirm the work was benign, or resume; the task simply stopped making progress.

What was NOT present in any flagged content

  • No security tooling, exploit code, or offensive-technique references
  • No production/live-system access — the agent's own stated task explicitly scoped itself to test/paper-only work and named the exact gates blocking any live/production activation
  • No credentials, tokens, or secrets in any visible text
  • No content resembling an actual security-research request of any kind

Suspected trigger (unconfirmed)

The flagged steps have one thing in common: they're the routine shape of any autonomous coding agent's work — repeated shell command invocations, file edits, and inter-agent messaging inside one long-running, unattended session. It looks more like a volume/pattern-based heuristic (many tool calls of a certain shape in sequence) than a content classifier reacting to anything actually said. If that's correct, the "possible cybersecurity risk" framing is actively misleading — a rate-limit or throttling message would be an honest description of what's happening; "you might be doing security research" is not.

Ask

  1. Investigate why an unattended agent's routine shell-command / file-edit / sub-agent-messaging automation is tripping a "possible cybersecurity risk" classifier with no security-relevant content anywhere in the flagged turns.
  2. Separate the failure modes: a soft "this got flagged, want to rephrase?" notice is recoverable; silently degrading a long-running unattended task's status to Goal blocked with no way to self-correct in-session is a much more severe failure and needs its own fix independent of the classifier accuracy issue.
  3. If this is intentional throttling rather than a security determination, surface it as that — the current "Trusted Access for Cyber" framing tells the user they're doing something they're not.

Evidence available

Four mobile-app screenshots from one continuous session, timestamped roughly 5-6 minutes apart across a 20-minute span, each showing the flag box immediately following a benign, visible tool-call sequence (shell command runs, a file edit, a test-file creation, a sub-agent message). Happy to attach on request.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the four timestamped screenshots and reproducing the described unattended iOS session with routine shell/PowerShell commands, file edits, and sub-agent messaging. Done means distinguishing classifier false positives from repeated-call escalation, and documenting separate behavior for recoverable warnings versus Goal blocked, including the user-facing message and recovery path.

Written by the indexing model from the issue text.

Assessment

Tech stack
ios
Domain
mobile, security
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.