AltimateAI / AltimateAI/altimate-code

`webfetch`: high failure rate from invalid/broken URLs — consider pre-validation

Aberta
#471 0 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
TypeScript
Estrelas
811
Forks
134
Merge médio
3d 2h
PRs com merge (30d)
50

Descrição

## Problem

`webfetch` is the #1 failing tool by volume — 934 failures in a single day, accounting for 55% of all tool failures. Breakdown:

| Error | Count |
|-------|------:|
| HTTP 404 (Not Found) | 810 |
| HTTP 403 (Forbidden) | 52 |
| Invalid URL | 51 |
| HTTP 429 (Rate Limited) | 21 |

The model frequently generates URLs that don't exist (documentation pages, API endpoints, GitHub links with wrong paths). Each failed fetch wastes a tool call and the model often retries the same broken URL.

## Impact

- Inflates the overall failure rate (55% of all failures)
- Wastes tool calls and tokens on retries
- Degrades user experience when the agent keeps trying broken URLs

## Suggested improvements

1. **URL validation before fetch** — reject obviously malformed URLs at the tool level
2. **Cache 404s** — if a URL returned 404, don't retry the same URL in the same session
3. **Rate limit handling** — on 429, respect `Retry-After` header or back off automatically instead of reporting as a failure
4. **Consider reducing retry behavior** — if the model gets a 404, the error message should clearly state the URL doesn't exist so the model doesn't retry

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.