getappmap / getappmap/appmap-js

Sonnet rate limits are unhandled

Open
#1,996 1 comment 0 reactions 1 assignee View on GitHub

@dividedmind is already working on this.

Since Sep 18, 2024.

bug navie-plan
Dominant language
TypeScript
Stars
53
Forks
18
Avg merge
3d 18h
Merged PRs (30d)
8

Description

https://github.com/getappmap/navie-benchmark/actions/runs/10895709882/job/30234378127#step:7:472

The issue description will be provided as context within a `<issue-description>` tag.
Error: Failed to complete: 429 {"type":"error","error":{"type":"rate_limit_error","message":"Number of request tokens has exceeded your per-minute rate limit (https://docs.anthropic.com/en/api/rate-limits); see the response headers for current usage. Please reduce the prompt length or the maximum tokens requested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your options for a rate limit increase."}}
    at AnthropicCompletionService.complete_1 (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:185:23)
    at complete_1.throw (<anonymous>)
    at resume (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:24:44)
    at reject (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:27:30)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Handling exception: Error: Failed to complete: 429 {"type":"error","error":{"type":"rate_limit_error","message":"Number of request tokens has exceeded your per-minute rate limit (https://docs.anthropic.com/en/api/rate-limits); see the response headers for current usage. Please reduce the prompt length or the maximum tokens requested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your options for a rate limit increase."}}
    at AnthropicCompletionService.complete_1 (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:185:23)
    at complete_1.throw (<anonymous>)
    at resume (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:24:44)
    at reject (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:27:30)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Stack trace: Error: Failed to complete: 429 {"type":"error","error":{"type":"rate_limit_error","message":"Number of request tokens has exceeded your per-minute rate limit (https://docs.anthropic.com/en/api/rate-limits); see the response headers for current usage. Please reduce the prompt length or the maximum tokens requested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your options for a rate limit increase."}}
    at AnthropicCompletionService.complete_1 (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:185:23)
    at complete_1.throw (<anonymous>)
    at resume (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:24:44)
    at reject (/home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/navie/dist/services/anthropic-completion-service.js:27:30)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

[solve-instance] (astropy__astropy-13398) Error: Failed to execute command APPMAP_NAVIE_TEMPERATURE=0.0 node /home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/cli/built/cli.js navie --log-navie -i /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.txt -p /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.prompt.md --trajectory-file /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/trajectory.jsonl -o /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.md > /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.log 2>&1. See /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.log for details.
Traceback (most recent call last):
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 232, in with_error_reporting
    return fn()
           ^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 357, in <lambda>
    with_error_reporting(lambda: with_container(solve_test_and_code))
                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 226, in with_container
    return fn(container)
           ^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 339, in solve_test_and_code
    in_source_dir(
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 247, in in_source_dir
    return fn()
           ^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 340, in <lambda>
    lambda: solve_code(edit_test_file, test_patch, inverted_patch)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/solve_instance.py", line 313, in solve_code
    solver.solve()
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/solve_code.py", line 81, in solve
    generate_code_result = generate_and_validate_code(
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/generate_and_validate_code.py", line 287, in generate_and_validate_code
    code_patches = retry_generate_code(
                   ^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/generate_and_validate_code.py", line 141, in retry_generate_code
    results = func(attempt)
              ^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/generate_and_validate_code.py", line 173, in generate_patch
    code_patch = generate_code(generate_code_dir, plan, list(test_errors))
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/solve_code.py", line 228, in generate_code
    lint_repair_result = self.lint_repair(
                         ^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/solve_base.py", line 129, in lint_repair
    lint_repair_result = lint_repair(
                         ^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/lint_repair.py", line 35, in lint_repair
    patch = generator(generate_attempt, distinct_lint_errors)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/solve_code.py", line 225, in generate
    code = generator.generate(attempt, lint_errors, test_errors)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/solver/workflow/generate_code.py", line 110, in generate
    return editor.generate(
           ^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/editor.py", line 347, in generate
    with_cache(
  File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/with_cache.py", line 25, in with_cache
    result = implementation_func()
             ^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/editor.py", line 334, in _generate
    self._build_client(work_dir).generate(
  File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/client.py", line 273, in generate
    self._execute(command, log_file)
  File "/home/runner/work/navie-benchmark/navie-benchmark/submodules/navie-editor/navie/client.py", line 378, in _execute
    raise RuntimeError(
RuntimeError: Failed to execute command APPMAP_NAVIE_TEMPERATURE=0.0 node /home/runner/work/navie-benchmark/navie-benchmark/submodules/appmap-js/packages/cli/built/cli.js navie --log-navie -i /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.txt -p /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.prompt.md --trajectory-file /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/trajectory.jsonl -o /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.md > /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.log 2>&1. See /home/runner/work/navie-benchmark/navie-benchmark/solve/astropy__astropy-13398/navie/solve-code-1/generate-code/attempt-1/code-1/generate/generate.log for details.

cc: @dividedmind

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.