bigscience-workshop / bigscience-workshop/petals

The prompt tuning example (prompt-tuning-sst2) don't work

Open
#241 14 comments 0 reactions 1 assignee Claimed by @justheuristic View on GitHub
help wanted
Dominant language
Python
Stars
10.6k
Forks
650
PR merge metrics
No merged PRs in 30d

Description

Hi,
I have tried to run the notebook example you have published (without editing) in colab but it doesn't work...
I get the following error:
```
RuntimeError Traceback (most recent call last)
[](https://localhost:8080/#) in
17
18 model.train()
---> 19 outputs = model(**batch)
20 loss = outputs.loss
21 loss.backward()

3 frames
[/usr/local/lib/python3.8/dist-packages/torch/nn/modules/linear.py](https://localhost:8080/#) in forward(self, input)
112
113 def forward(self, input: Tensor) -> Tensor:
--> 114 return F.linear(input, self.weight, self.bias)
115
116 def extra_repr(self) -> str:

RuntimeError: expected scalar type Half but found Float
```
It is probably about the transformers version out of date but petals 1.1.1 requires transformers==4.25.1

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.