huggingface / huggingface/transformers.js-examples

Running LoRA fine tuned versions of LLama 3.2 using transformers.js

Open
#8 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
JavaScript
Stars
2.1k
Forks
251
PR merge metrics
No merged PRs in 30d

Description

Hello,

I am wondering if it’s possible to run a LoRA fine-tuned version of LLaMA 3.2 in the browser using transformers.js. Ideally, I would like to load the base model once and then dynamically load and swap between different LoRA adapters at runtime based on the current task, without reloading the base model each time.

Is this supported in transformers.js? If so, are there any tutorials or examples illustrating how to set this up in a browser environment?

Any guidance or documentation on this would be greatly appreciated. Thank you!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.