sassoftware / sassoftware/sas-copilot

Hallucinate and invents data set name when asked for test data set

Open
#46 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
TypeScript
Stars
12
Forks
1
Avg merge
4m
Merged PRs (30d)
1

Description

Is your feature request related to a problem? Please describe.
When I create a data set test and I ask to generate code to view the data set, it invents a data set name:

  1. Provided code:
data test;
    /* Assign values to variables */
    a = 1;
    b = 2;
    c = 3;
run;

/* View test data set */
  1. Click on Generate Code of the comment /* View test data set */
  2. Generated code:
proc sql;
    select *
    from mycas.acetyl;
quit;

Describe the solution you'd like
View the data set test instead of acetyl.

Reporter's Organization
SAS

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the issue through the Generate Code action using the provided DATA step and the “View test data set” comment. Check how the assistant resolves the test data set name from the preceding code, and consider the work complete when the generated query refers to the test data set rather than “mycas.acetyl.”

Written by the indexing model from the issue text.

Assessment

Domain
ai
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.