huggingface / huggingface/Google-Cloud-Containers

Can we use Multi-LORA CPU

Open
#128 3 comments 0 reactions 1 assignee Claimed by @alvarobartt View on GitHub
question
Dominant language
Dockerfile
Stars
185
Forks
31
Avg merge
10m
Merged PRs (30d)
1

Description

Hi,

Im currently following this doc: https://huggingface.co/docs/google-cloud/en/examples/gke-tgi-multi-lora-deployment

After got a bug: "Can’t scale up due to exceeded quota" and do some research, I suspect that my free trial (300$) account is not able to increase GPU quota (even I have activated my account to not be trial anymore and have to contact sale)

Is there anyway I can run this with cpu instead.

Thank you

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.