agentscope-ai / agentscope-ai/AgentTeams

Implement automatic retry logic for LLM rate limits (HTTP 429) to ensure workflow continuity

Ouverte
#149 1 commentaire 0 réactions 1 personne assignée Réclamée par @qiacheng7 Voir sur GitHub
area:model-higress
Langage dominant
Go
Étoiles
5.6k
Forks
692
Merge moyen
5 j 4 h
PR mergées (30 j)
23

Description

Here is a suggestion based on my usage experience:

In your development and testing scenarios, token quotas are likely plentiful. However, in actual production use, I've found that when the LLM API hits its rate limit (HTTP 429), the Hiclaw bot halts the entire workflow. The process stops completely, requiring me to manually re-mention the bot to resume work.

I attempted to add custom rules instructing the bot to retry after receiving a 429 error, but its adherence to these instructions has been inconsistent and unreliable.

In contrast, tools like claude-code handle this scenario exceptionally well. Their automatic retry mechanism after a 429 error allows for a truly hands-off experience; I can simply check back later to verify the results without needing to monitor the process.

This issue significantly impacts usability. My primary goal in using this tool is automation, and having workflows break due to rate limits defeats that purpose. Implementing robust, native retry logic would greatly improve the reliability of Hiclaw for automated tasks.

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.