agentscope-ai / agentscope-ai/AgentTeams

Implement automatic retry logic for LLM rate limits (HTTP 429) to ensure workflow continuity

Đang mở
#149 1 bình luận 0 reaction 1 người được giao Được @qiacheng7 nhận Xem trên GitHub
area:model-higress
Ngôn ngữ chính
Go
Star
5.6k
Fork
692
Merge trung bình
5 ngày 4 giờ
Pull request đã merge (30 ngày)
23

Mô tả

Here is a suggestion based on my usage experience:

In your development and testing scenarios, token quotas are likely plentiful. However, in actual production use, I've found that when the LLM API hits its rate limit (HTTP 429), the Hiclaw bot halts the entire workflow. The process stops completely, requiring me to manually re-mention the bot to resume work.

I attempted to add custom rules instructing the bot to retry after receiving a 429 error, but its adherence to these instructions has been inconsistent and unreliable.

In contrast, tools like claude-code handle this scenario exceptionally well. Their automatic retry mechanism after a 429 error allows for a truly hands-off experience; I can simply check back later to verify the results without needing to monitor the process.

This issue significantly impacts usability. My primary goal in using this tool is automation, and having workflows break due to rate limits defeats that purpose. Implementing robust, native retry logic would greatly improve the reliability of Hiclaw for automated tasks.

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.