JetBrains-Research / JetBrains-Research/TestSpark

`HuggingFaceRequestManager` has Llama-specific prompt instuction

Open
#289 0 comments 0 reactions 0 assignees View on GitHub
new feature refactoring
Dominant language
Kotlin
Stars
88
Forks
24
PR merge metrics
No merged PRs in 30d

Description

**Describe the bug**
The method `HuggingFaceRequestManager.createInstructionPrompt` [here](https://github.com/JetBrains-Research/TestSpark/blob/a5c0e7a6ce0daffb01fbf522109cc78706aad613/src/main/kotlin/org/jetbrains/research/testspark/tools/llm/generation/hf/HuggingFaceRequestManager.kt#L97C17-L97C40) is Llama specific. The implementation should be rewritten so that Llama-specific features are applied only to Llama models.

**Screenshots**
Screenshot 2024-07-05 at 13 22 24

Contributor guide

Open the contributing guide

Research direction

Start in src/main/kotlin/org/jetbrains/research/testspark/tools/llm/generation/hf/HuggingFaceRequestManager.kt and inspect createInstructionPrompt at the referenced location. Trace how the selected model is identified and verify the current prompt behavior for Llama and non-Llama models. Done means Llama-specific features are applied only to Llama models.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, kotlin
Domain
ai
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.