aaif-goose / aaif-goose/goose

Goose vision capability with LM Studio provider using qwen/qwen3.8-27 and new LM Studio REST APIv1

Ouverte
#12,009 1 commentaire 0 réactions 1 personne assignée Réclamée par @jbg Voir sur GitHub
Langage dominant
Rust
Étoiles
54.2k
Forks
6.2k
Merge moyen
3 j 4 h
PR mergées (30 j)
240

Description

I am replying to both issues 11895 and 11896. they are twofold but probably part of the same, attaching the latest diagnostics with an incomplete prompt on the topics I ran on my local AI inference setup, the one object of this email:

Goose does not have qwen/qwen3.8-27b included in its models catalog for LM Studio provider, this does not let it loads vision capability and it defaults to false setting.
Furthermore, Goose has not implemented the new LM Studio REST API v1 yet, which allows for more functions calling/endpoints, including the total token output, among many others (including vision capability endpoint). The openai-compatible API from LM studio does not have it. This probably impairs the auto-compact feature to work properly as well.

Let me know if you need additional info, otherwise the system setup is working great.

Thanks a lot

**Please provide the following information**
- **OS & Arch:** linux 7.2.4-201.nobara.fc44.x86_64 x86_64
- **Interface:** UI
- **Version:** 1.50.0
- **Extensions enabled:** computercontroller, developer, scheduler, code_execution, todo, Extension Manager, summarize, tom, chatrecall, apps, analyze, skills, summon, autovisualiser, memory, Fetch, Playwright, YouTube Transcript, Tavily Web Search
- **Provider & Model:** lmstudio - qwen/qwen3.8-27b

---

**Additional context**
Add any other context about the problem here.

[diagnostics_20260911_3.json](https://github.com/user-attachments/files/32098577/diagnostics_20260911_3.json)

Guide de contribution

Ouvrir le guide de contribution

Piste de recherche

Look at the LM Studio provider implementation in the codebase, likely under a providers or integrations directory. Identify where the models catalog is defined and where the API client interacts with LM Studio. Check the new LM Studio REST API v1 documentation to understand the vision capability endpoint and other new functions. The work involves updating the API client, adding the qwen model to the catalog, and enabling vision support.

Rédigé par le modèle d'indexation à partir du texte de l'issue.

Évaluation

Domaine
ai-infra-agents
Type d'issue
Fonctionnalité
Difficulté
4/5
Temps estimé
3-5 jours
Activité
Active
Clarté
Plutôt claire
Accessibilité débutants
45/100

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.