Agent safeguard repeatedly flags ordinary dev automation as "possible cybersecurity risk," escalating to a full goal block on a long-running unattended task
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 125k
- Forks
- 19.4k
- PR merge metrics
- PR metrics pending
Description
Environment
- Codex mobile app (iOS)
- An agent session running an unattended, multi-day automated software task (build/test/refactor work on a personal project), controlled remotely via the mobile app
- No security research, exploit development, red-team activity, or credential-related work occurred in any of the flagged steps
What happened
Over a roughly 20-minute window in one continuous session, the same false-positive safety flag fired four separate times, each time immediately after entirely ordinary agent actions:
- Running shell/PowerShell commands (routine build and test tooling)
- Editing and creating project script and test files
- Sending a status message to a sub-agent handling a separate bounded task
- Agent reasoning text describing pipeline steps, internal gating/validation logic, and a fix to an orchestration bug — no security-relevant content, no credentials, no exploit code, no mention of any external target
Every one of the four occurrences produced the identical UI message:
"This content was flagged for possible cybersecurity risk. If this seems wrong, try rephrasing your request. To get authorized for security work, join the Trusted Access for Cyber program: https://chatgpt.com/cyber"
Impact — this is not just a warning
This is not a single false-positive notice that the user can shrug off. Across the four occurrences the session's own status indicator visibly degraded:
Pursuing goal(first two occurrences)- →
Queued(third occurrence, mid-response) - →
Goal blocked(fourth occurrence)
The safeguard did not just mis-flag benign automation — it accumulated across repeated ordinary tool calls until it halted a multi-day unattended background task. There was no in-session way to provide clarifying context, confirm the work was benign, or resume; the task simply stopped making progress.
What was NOT present in any flagged content
- No security tooling, exploit code, or offensive-technique references
- No production/live-system access — the agent's own stated task explicitly scoped itself to test/paper-only work and named the exact gates blocking any live/production activation
- No credentials, tokens, or secrets in any visible text
- No content resembling an actual security-research request of any kind
Suspected trigger (unconfirmed)
The flagged steps have one thing in common: they're the routine shape of any autonomous coding agent's work — repeated shell command invocations, file edits, and inter-agent messaging inside one long-running, unattended session. It looks more like a volume/pattern-based heuristic (many tool calls of a certain shape in sequence) than a content classifier reacting to anything actually said. If that's correct, the "possible cybersecurity risk" framing is actively misleading — a rate-limit or throttling message would be an honest description of what's happening; "you might be doing security research" is not.
Ask
- Investigate why an unattended agent's routine shell-command / file-edit / sub-agent-messaging automation is tripping a "possible cybersecurity risk" classifier with no security-relevant content anywhere in the flagged turns.
- Separate the failure modes: a soft "this got flagged, want to rephrase?" notice is recoverable; silently degrading a long-running unattended task's status to
Goal blockedwith no way to self-correct in-session is a much more severe failure and needs its own fix independent of the classifier accuracy issue. - If this is intentional throttling rather than a security determination, surface it as that — the current "Trusted Access for Cyber" framing tells the user they're doing something they're not.
Evidence available
Four mobile-app screenshots from one continuous session, timestamped roughly 5-6 minutes apart across a 20-minute span, each showing the flag box immediately following a benign, visible tool-call sequence (shell command runs, a file edit, a test-file creation, a sub-agent message). Happy to attach on request.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the four timestamped screenshots and reproducing the described unattended iOS session with routine shell/PowerShell commands, file edits, and sub-agent messaging. Done means distinguishing classifier false positives from repeated-call escalation, and documenting separate behavior for recoverable warnings versus Goal blocked, including the user-facing message and recovery path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- ios
- Domain
- mobile, security
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100