AlexsJones / AlexsJones/llmfit

[Feature]: Add a guided CLI wizard for goal-driven model recommendations

Ouverte
#1,015 3 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
enhancement
Langage dominant
Rust
Étoiles
36.5k
Forks
2.3k
Merge moyen
3 j 1 h
PR mergées (30 j)
95

Description

### Problem or motivation

LLM Fit already does a great job of evaluating models against a user's hardware and provides use-case-specific recommendations. However, using these capabilities still requires the user to understand concepts such as model categories, use cases, hardware constraints, and the available CLI options.

For a non-technical or first-time user, the starting point is usually not:

_"Which model should I run for the coding use case?"_

Instead, it is more likely to be:

_"I want a local AI model that can help me summarize PDFs and answer questions about them. What should I use on my computer?"_

There is currently a gap between what the user wants to accomplish and how LLM Fit expects that intent to be expressed through its existing interfaces.

A guided CLI experience could make the existing recommendation engine more accessible without changing or duplicating the underlying model-fitting logic.

### Proposed solution

Add an optional interactive CLI wizard, for example:

**llmfit wizard**

The wizard could ask a small number of simple questions about the user's intended workload and priorities, such as:

What do you want to use a local AI model for?
How important is response speed versus model quality?
Do you need a large context window?
Do you need vision/multimodal capabilities?

The wizard would then translate these answers into the existing LLM Fit recommendation/use-case system and return a ranked list of suitable models for the user's detected hardware.

For example:

**$ llmfit wizard**

What do you want to use a local AI model for?

1. General assistant
2. Coding
3. Documents / PDFs
4. Reasoning
5. Writing
6. Images / multimodal

> 3

What matters most to you?

1. Best quality
2. Fast responses
3. Balanced

> 3

Analyzing your hardware...

Recommended models:

1. Model X — Q4_K_M
Best overall fit for your hardware and document workflow

2. Model Y — Q5_K_M
Higher quality, but slower

3. Model Z — Q4_K_M
Faster alternative

The important part is that this would be a UX layer over the existing recommendation capabilities, rather than a replacement for the current recommendation engine.

It could also remain completely optional, so existing users can continue using the current CLI/TUI workflows.

### Alternatives considered

A few alternative approaches could also be considered:

Extend the existing recommend command with an interactive mode rather than introducing a separate wizard command.
Add a **--interactive** flag, for example:
llmfit recommend **--interactive**
Expand the existing TUI to provide a guided recommendation flow.
Keep the CLI unchanged and expose the same functionality through the existing web interface.

I would personally favor an interactive CLI flow as the initial implementation because it keeps the feature lightweight, terminal-friendly, and relatively isolated from the existing recommendation engine.

### Feature area

CLI (new subcommand or flag)

### Would you be willing to contribute this?

Yes, I'd like to submit a PR

### Additional context

_No response_

Guide de contribution

Ouvrir le guide de contribution

Piste de recherche

Start by reading the existing CLI entry points, especially the current recommend command and the recommendation/use-case system it calls. Decide whether the UX should be a new llmfit wizard subcommand or an interactive flag, since the issue leaves that open. Done means the interactive flow asks the proposed goal/priority questions, maps answers to existing recommendations, and returns ranked models without replacing the current engine.

Rédigé par le modèle d'indexation à partir du texte de l'issue.

Évaluation

Stack technique
rust
Domaine
ai, cli
Type d'issue
Fonctionnalité
Difficulté
5/5
Temps estimé
Plus d'une semaine
Activité
Active
Clarté
Plutôt claire
Accessibilité débutants
32/100

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.