iOfficeAI / iOfficeAI/AionCore
Provider health checks can time out on thinking-enabled models
- Dominant language
- Rust
- Stars
- 105
- Forks
- 169
- Avg merge
- 5h 58m
- Merged PRs (30d)
- 84
Description
## Problem
Provider health checks use a short prompt and a 30-second timeout, but the probe is initialized like a full agent session. Thinking-enabled models can spend the timeout on reasoning and tool context instead of returning the health-check response.
A working provider was reported unhealthy after 30.13 seconds even though regular requests succeeded. Disabling thinking alone was insufficient because the probe still advertised 10 agent tools.
## Expected behavior
A health check should test provider reachability and basic generation without advertising agent tools or enabling thinking.
## Proposed fix
Build the health-check engine with thinking disabled and an empty tool policy. Keep this configuration scoped to probes so normal conversations remain unchanged.
## Validation
With both changes applied, the same live probe completed successfully in 18.77 seconds within the existing timeout. Advertised tools dropped from 10 to 0 and input tokens dropped from approximately 2,850 to 449.
Targeted tests, formatting, clippy, diff checks, the debug build, and the full workspace pre-push gate pass.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start at the provider health-check engine and its targeted tests; the issue does not name specific files or entry points. Verify that probes disable thinking and advertise an empty tool policy while normal conversations remain unchanged, then run the targeted tests and the listed formatting, clippy, diff, build, and workspace checks.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- backend-api-design
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 68/100