openedx / openedx/openedx-ai-extensions

Differential behavior across the same prompt

Open
#146 3 comments 0 reactions 1 assignee View on GitHub

@felipemontoya is already working on this.

Since Apr 8, 2026.

bug
Dominant language
Python
Stars
17
Forks
11
Avg merge
5h 33m
Merged PRs (30d)
4

Description

Prompt

Generate 5 check your knowledge questions from this section. Output them a flashcards in the Anki basic csv format where the first column is the question and the second column is the answer. Use semi-colons as the field seperator, separate each row with a newline.

Response

I can generate them, but I need the content of "this section" to ensure accuracy. Do you want me to:

fetch the current page content from your course and generate 5 flashcards, or
paste the section text here, or
tell me the topic or key concepts you want covered?
If you want me to fetch, say: “Yes, fetch the current page content.” I will pull the content and then return 5 Anki-format flashcards (Question; Answer) with semicolons as separators.

The first couple of times I prompted with a similar prompt -- I've tweaked the separator instructors over time -- the LLM didn't present options and look for approval to move forward. This may be unavoidable, but it looks a little like it lost track of how to get the content page content in this case.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.