huggingface / huggingface/smol-course
3_parameter_efficient_finetuning/notebooks/finetune_sft_peft.ipynb inference error
Open
- Dominant language
- Jupyter Notebook
- Stars
- 6.7k
- Forks
- 2.3k
- PR merge metrics
- No merged PRs in 30d
Description
In the last notebook cell, when attempting to run inference on the trained model, when we enter the following loop:
for prompt in prompts:
print(f" prompt:\n{prompt}")
print(f" response:\n{test_inference(prompt)}")
print("-" * 50)
the very first prompt fed into 'test_inference(prompt)' generates the following error:
'Input length of input_ids is 31, but `max_length` is set to 20. This can lead to unexpected behavior. ...'
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.