aws / aws/aws-toolkit-vscode

AmazonQ skips lines of code without knowledge

Open
#5,966 1 comment 0 reactions 0 assignees View on GitHub
amazon-q bug codewhisperer partner-team
Dominant language
TypeScript
Stars
2k
Forks
807
Avg merge
10h 12m
Merged PRs (30d)
7

Description

## Problem
When asked to generate code, sometimes Q will write the whole program, but would skip out few lines without knowledge. When asked about it, it simply thinks that the code is complete, but the screen does not display it. Even when asked to re-write it will keep skipping the same lines.
Only way to find what is missing is by asking line by line explanation, where you will see the line that is missing with explanations.

## Steps to reproduce the issue
Its incidental and cannot be easily replicated, but I have have seen it more than 10 times out of 30.

1. Go to Q Chat
2. Ask a programming question, preferably a large code
3. Review the code returned to see some lines skipped.
4. Ask to re-write the code and it will keep skipping.
5. For the skipped line, ask Q to explain line by line that code block and it will explain it as if it is there and we cannot just see it.

## Expected behavior
All lines should be there in the codebase..

## System details (run `AWS: About` and/or `Amazon Q: About`)

OS: Linux x64 5.10.227-198.884.### (Mac OS)
Visual Studio Code extension host: 1.87.2
Amazon Q: 1.34.0
node: 18.17.1

Contributor guide

Open the contributing guide

Research direction

Start in the Q Chat flow in the VS Code extension and reproduce the issue with a large programming request, recording the Amazon Q, extension host, Node, and OS versions. Compare the generated response with its displayed code and line-by-line explanation to determine whether lines are omitted from generation or only from display; done means the omission is reliably characterized and verified as fixed.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript, vscode
Domain
ai, devtools
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.