aws / aws/aws-toolkit-vscode

When asking questions to Q about CDK python many responses include functions or attributes that do not exist. How can this behaviour be avoided?

Open
#4,946 0 comments 0 reactions 0 assignees View on GitHub
amazon-q guidance
Dominant language
TypeScript
Stars
2k
Forks
807
Avg merge
10h 12m
Merged PRs (30d)
7

Description

## System details (run `AWS: About` and/or `Amazon Q: About`)

OS: Darwin arm64 23.4.0
Visual Studio Code extension host: 1.89.0
Amazon Q: 1.2.0
node: 18.18.2
electron: 28.2.8

## Question

Sample question:
"How do I get the CNAME record values for an ACM certificate created in CDK Python?"

The response is (only part of it):
cname_records = cert.get_resource_record_set()
cert is an object of type aws_cdk.aws_certificatemanager

The documentation for this construct is
https://docs.aws.amazon.com/cdk/api/v2/python/aws_cdk.aws_certificatemanager/Certificate.html

The documentation clearly shows Certificate has no member of get_resource_record_set()

I have encountered so many instances of this behaviour that Q is almost unusable for anything but trivial questions on CDK.

Contributor guide

Open the contributing guide

Research direction

No repository file, test, or entry point is identified. Start by reproducing the sample Amazon Q question against the linked AWS CDK Certificate documentation, then investigate how responses are evaluated for API accuracy. Done means the reported response no longer recommends functions or attributes absent from the referenced documentation.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
ai, developer-experience
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.