ProjectTech4DevAI / ProjectTech4DevAI/kaapi-backend
Assessment Configuration: Attach rubric documents
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 18
- Forks
- 10
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 14
Description
Is your feature request related to a problem?
Currently, rubric and knowledge documents can only be included inline in the prompt. This limitation impacts the flexibility and usability of the assessor configuration.
Describe the solution you'd like
- Enable the assessor config to attach rubric and knowledge documents, rather than just inline text.
- Ensure attached documents are provided to the LLM as attachments during the assessment process.
Original issue
Context
Currently model answer sheets and knowledge/rubric documents can only be placed inline in the prompt. Ability to attach rubric/knowledge docs in the assessor config is missing.
Acceptance criteria
- Assessor config supports attaching rubric/knowledge documents (not just inline prompt text).
- Attached docs are provided to the LLM as attachments in the assessment path.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing how assessor configuration represents inline rubric and knowledge documents, then follow the assessment path where those values are sent to the LLM. Done means the assessor config accepts attached rubric and knowledge documents and the assessment sends those documents as LLM attachments; add or update coverage for both acceptance criteria.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100