When asking questions to Q about CDK python many responses include functions or attributes that do not exist. How can this behaviour be avoided?
- Dominant language
- TypeScript
- Stars
- 2k
- Forks
- 807
- Avg merge
- 10h 12m
- Merged PRs (30d)
- 7
Description
## System details (run `AWS: About` and/or `Amazon Q: About`)
OS: Darwin arm64 23.4.0
Visual Studio Code extension host: 1.89.0
Amazon Q: 1.2.0
node: 18.18.2
electron: 28.2.8
## Question
Sample question:
"How do I get the CNAME record values for an ACM certificate created in CDK Python?"
The response is (only part of it):
cname_records = cert.get_resource_record_set()
cert is an object of type aws_cdk.aws_certificatemanager
The documentation for this construct is
https://docs.aws.amazon.com/cdk/api/v2/python/aws_cdk.aws_certificatemanager/Certificate.html
The documentation clearly shows Certificate has no member of get_resource_record_set()
I have encountered so many instances of this behaviour that Q is almost unusable for anything but trivial questions on CDK.
Contributor guide
Research direction
No repository file, test, or entry point is identified. Start by reproducing the sample Amazon Q question against the linked AWS CDK Certificate documentation, then investigate how responses are evaluated for API accuracy. Done means the reported response no longer recommends functions or attributes absent from the referenced documentation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- ai, developer-experience
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100