explosion / explosion/spacy-llm

`transformers` > 4.38 causes bug in inference for HF models

Open
#463 0 comments 0 reactions 0 assignees View on GitHub
bug feat/model
Dominant language
Python
Stars
1.4k
Forks
110
PR merge metrics
No merged PRs in 30d

Description

Inference fails with
```
TypeError: transformers.generation.utils.GenerationMixin.generate() got multiple values for keyword argument 'pad_token_id'
```.
Cause for this is unclear so far.

Workaround for the time being is to pin `transformers` to <= 4.38.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.