huggingface / huggingface/llm-vscode

Defaults model ID to bigcode/starcoder but then complains that it's too large to use

Open
#148 1 comment 0 reactions 0 assignees View on GitHub
stale
Dominant language
TypeScript
Stars
1.3k
Forks
142
Avg merge
3m
Merged PRs (30d)
2

Description

By default, the extension uses bigcode/starcoder as the model. This causes VSC to frequently display errors stating: "inference api error: The model bigcode/starcoder is too large to be loaded automatically (63GB > 10GB)."

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.