AltimateAI / AltimateAI/altimate-code

`webfetch`: high failure rate from invalid/broken URLs — consider pre-validation

Abierto
#471 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
TypeScript
Estrellas
811
Forks
134
Merge medio
3 d 2 h
PR fusionados (30 d)
50

Descripción

## Problem

`webfetch` is the #1 failing tool by volume — 934 failures in a single day, accounting for 55% of all tool failures. Breakdown:

| Error | Count |
|-------|------:|
| HTTP 404 (Not Found) | 810 |
| HTTP 403 (Forbidden) | 52 |
| Invalid URL | 51 |
| HTTP 429 (Rate Limited) | 21 |

The model frequently generates URLs that don't exist (documentation pages, API endpoints, GitHub links with wrong paths). Each failed fetch wastes a tool call and the model often retries the same broken URL.

## Impact

- Inflates the overall failure rate (55% of all failures)
- Wastes tool calls and tokens on retries
- Degrades user experience when the agent keeps trying broken URLs

## Suggested improvements

1. **URL validation before fetch** — reject obviously malformed URLs at the tool level
2. **Cache 404s** — if a URL returned 404, don't retry the same URL in the same session
3. **Rate limit handling** — on 429, respect `Retry-After` header or back off automatically instead of reporting as a failure
4. **Consider reducing retry behavior** — if the model gets a 404, the error message should clearly state the URL doesn't exist so the model doesn't retry

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.