IntelLabs / IntelLabs/Xe-Forge

Ask the LLM to return a patch instead of full optimized code?

Open
#42 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
21
Forks
8
PR merge metrics
No merged PRs in 30d

Description

It may exceed the output length limitation of the LLM if the full optimized code is requested.
The message I saw:
```

Expected to find output fields in the LM response: [optimized_code, next_thought]
Actual output fields parsed from the LM response: [optimized_code]
```

How about asking LLM to only return a patch instead of the full code?

A straightforward idea is to modify the prompt to the LLM to tell it to return a patch instead of the full optimized code. But the change may also affect the parser and other operations after LLM returns. Can anyone help with it? Thanks.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.