getappmap / getappmap/appmap-js
Sonnet rate limits are unhandled
Open
@dividedmind is already working on this.
Since Sep 18, 2024.
bug
navie-plan
- Dominant language
- TypeScript
- Stars
- 53
- Forks
- 18
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
https://github.com/getappmap/navie-benchmark/actions/runs/10895709882/job/30234378127#step:7:472
The issue description will be provided as context within a `<issue-description>` tag.
Error: Failed to complete: 429 {"type":"error","error":{"type":"rate_limit_error","message":"Number of request tokens has exceeded your per-minute rate limit (https://docs.anthropic.com/en/api/rate-limits); see the response headers for current usage. Please reduce the prompt length or the maximum tokens requested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your options for a rate limit increase."}}
at AnthropicCompletionService.complete_1 (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:185:23)
at complete_1.throw (<anonymous>)
at resume (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:24:44)
at reject (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:27:30)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Handling exception: Error: Failed to complete: 429 {"type":"error","error":{"type":"rate_limit_error","message":"Number of request tokens has exceeded your per-minute rate limit (https://docs.anthropic.com/en/api/rate-limits); see the response headers for current usage. Please reduce the prompt length or the maximum tokens requested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your options for a rate limit increase."}}
at AnthropicCompletionService.complete_1 (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:185:23)
at complete_1.throw (<anonymous>)
at resume (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:24:44)
at reject (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:27:30)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Stack trace: Error: Failed to complete: 429 {"type":"error","error":{"type":"rate_limit_error","message":"Number of request tokens has exceeded your per-minute rate limit (https://docs.anthropic.com/en/api/rate-limits); see the response headers for current usage. Please reduce the prompt length or the maximum tokens requested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your options for a rate limit increase."}}
at AnthropicCompletionService.complete_1 (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:185:23)
at complete_1.throw (<anonymous>)
at resume (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:24:44)
at reject (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:27:30)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[solve-instance] (astropy__astropy-13398) Error: Failed to execute command APPMAP_NAVIE_TEMPERATURE=0.0 node /home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/cli/built/cli.js navie --log-navie -i /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.txt -p /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.prompt.md --trajectory-file /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/trajectory.jsonl -o /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.md > /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.log 2>&1. See /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.log for details.
Traceback (most recent call last):
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 232, in with_error_reporting
return fn()
^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 357, in <lambda>
with_error_reporting(lambda: with_container(solve_test_and_code))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 226, in with_container
return fn(container)
^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 339, in solve_test_and_code
in_source_dir(
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 247, in in_source_dir
return fn()
^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 340, in <lambda>
lambda: solve_code(edit_test_file, test_patch, inverted_patch)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 313, in solve_code
solver.solve()
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/solve_code.py", line 81, in solve
generate_code_result = generate_and_validate_code(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/generate_and_validate_code.py", line 287, in generate_and_validate_code
code_patches = retry_generate_code(
^^^^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/generate_and_validate_code.py", line 141, in retry_generate_code
results = func(attempt)
^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/generate_and_validate_code.py", line 173, in generate_patch
code_patch = generate_code(generate_code_dir, plan, list(test_errors))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/solve_code.py", line 228, in generate_code
lint_repair_result = self.lint_repair(
^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/solve_base.py", line 129, in lint_repair
lint_repair_result = lint_repair(
^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/lint_repair.py", line 35, in lint_repair
patch = generator(generate_attempt, distinct_lint_errors)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/solve_code.py", line 225, in generate
code = generator.generate(attempt, lint_errors, test_errors)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/generate_code.py", line 110, in generate
return editor.generate(
^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/editor.py", line 347, in generate
with_cache(
File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/with_cache.py", line 25, in with_cache
result = implementation_func()
^^^^^^^^^^^^^^^^^^^^^
File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/editor.py", line 334, in _generate
self._build_client(work_dir).generate(
File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/client.py", line 273, in generate
self._execute(command, log_file)
File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/client.py", line 378, in _execute
raise RuntimeError(
RuntimeError: Failed to execute command APPMAP_NAVIE_TEMPERATURE=0.0 node /home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/cli/built/cli.js navie --log-navie -i /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.txt -p /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.prompt.md --trajectory-file /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/trajectory.jsonl -o /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.md > /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.log 2>&1. See /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.log for details.
cc: @dividedmind
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.