microsoft / microsoft/LLMLingua
[Bug]: NotImplementedError
Open
@pzs19 is already working on this.
Since Jul 15, 2024.
bug
- Dominant language
- Python
- Stars
- 6.7k
- Forks
- 428
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 1
Description
Describe the bug
llmlingua-2 model is downed in hugging facing
code:
self.llm_lingua = PromptCompressor(
model_name="/home/webservice/llm/compressFromNet/llmlingua-2-xlm",
use_llmlingua2=True, # Whether to use llmlingua-2
)
compressed_prompt = self.llm_lingua.compress_prompt(
context, # context is str type
rate=0.33,
force_tokens = ['\n', '?'],
drop_consecutive=True,)
print(compressed_prompt)
err:
compressed_prompt = self.llm_lingua.compress_prompt(
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 472, in compress_prompt
return self.compress_prompt_llmlingua2(
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 776, in compress_prompt_llmlingua2
context_probs, context_words = self.__get_context_prob(
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 2134, in __get_context_prob
) = self.__merge_token_to_word(
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 2199, in __merge_token_to_word
elif is_begin_of_new_word(token, self.model_name, force_tokens, token_map):
File "/home/webservice/miniconda3/envs/tka/lib/python3.10/site-packages/llmlingua/utils.py", line 94, in is_begin_of_new_word
raise NotImplementedError()
NotImplementedError
Steps to reproduce
No response
Expected Behavior
No response
Logs
No response
Additional Information
No response
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.