aaif-goose / aaif-goose/goose

[Feature request]: Allow adding local GGUFs from disk

Open
#11,902 0 comments 0 reactions 1 assignee Claimed by @jbg View on GitHub
Dominant language
Rust
Stars
54.2k
Forks
6.2k
Avg merge
3d 4h
Merged PRs (30d)
240

Description

**What problem would this solve?**
It is incredibly wasteful to re-download gigabytes of data already present on the machine.
As well as it being near impossible on low-bandwidth networks.

**What would a good outcome look like?**
Being able to load GGUFs without having to _specifically_ download them through the app.

**Possible approaches**
Add a "Add local..." button to Local Inference to open a file chooser for GGUF.

**Additional context**
N/A

- [x] I have verified this does not duplicate an existing feature request

Do not begin implementation until the issue reaches **Ready** on the [Goose Issues board](https://github.com/orgs/aaif-goose/projects/1).

Contributor guide

Open the contributing guide

Research direction

Look for the Local Inference UI component and the model loading logic. The feature involves adding a file chooser dialog and integrating local GGUF file loading into the existing model management flow. Check how models are currently downloaded and instantiated to understand the required changes.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
ai, desktop
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Clearly specified
Newbie friendliness
65/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.