bigscience-workshop / bigscience-workshop/petals

Loading LoRA weights

Open
#320 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
650
PR merge metrics
No merged PRs in 30d

Description

I've gone through the documentation and paper but couldn't find a way to load locally-stored LoRA adapters. Suppose I have adapter weights stored in a local folder "./lora_weights/", how can I load them into the pre-trained model? Also, can I load multiple LoRAs from multiple local folders?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.