IntelLabs / IntelLabs/Xe-Forge
Ask the LLM to return a patch instead of full optimized code?
Open
- Dominant language
- Python
- Stars
- 21
- Forks
- 8
- PR merge metrics
- No merged PRs in 30d
Description
It may exceed the output length limitation of the LLM if the full optimized code is requested.
The message I saw:
```
Expected to find output fields in the LM response: [optimized_code, next_thought]
Actual output fields parsed from the LM response: [optimized_code]
```
How about asking LLM to only return a patch instead of the full code?
A straightforward idea is to modify the prompt to the LLM to tell it to return a patch instead of the full optimized code. But the change may also affect the parser and other operations after LLM returns. Can anyone help with it? Thanks.
Contributor guide
Assessment
This issue has not been assessed yet.