bigscience-workshop / bigscience-workshop/petals

Add convenience methods to export and import fine-tuned prompts

Open
#268 3 comments 0 reactions 0 assignees View on GitHub
1day enhancement good first issue help wanted
Dominant language
Python
Stars
10.6k
Forks
650
PR merge metrics
No merged PRs in 30d

Description

I can run["deep" prompt-tuning](https://github.com/bigscience-workshop/petals/blob/main/examples/prompt-tuning-personachat.ipynb) successfully.

but, how can I export the prefix tokens from the Petals client?
and, how can I use the prefix tokens which export from Petals client when I want to do some inference job?

I appreciate you help

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.