abi / abi/secret-llama

Could not load the model because Error: Cannot find adapter that matches the request

Open
#35 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
2.7k
Forks
172
PR merge metrics
No merged PRs in 30d

Description

I encountered an issue while trying to load a model in Secret Llama. The UI works correctly, but the models fail to initialize. Maybe because they are not linked to the UI. Instead, I get the following error message:

```
Could not load the model because Error: Cannot find adapter that matches the request
```

I couldn't find instructions in the repo on how to link LLMs to the UI?

---

### Steps to Reproduce
1. cloned the repo
2. ran `yarn` and `yarn build-and-preview`
3. opened UI

---

### Expected Behavior
The model should load and be ready for inference after selection.

---

### Observed Behavior
The application displays the error:
```
Could not load the model because Error: Cannot find adapter that matches the request
```

---

### Environment
- **Browser:** Google Chrome Version 131.0.6778.205 (Official Build) (arm64)
- **Operating System:** macOS Sequoia 15.1.1 (24B91)

---

### Additional Information
- I checked the issues page and documentation but couldn't find a solution.
- Is there a specific configuration where I can link the downloaded LLMs?
---

Thank you for your help and cool project!

Contributor guide

No contributing guide indexed for this repository

Research direction

Look at the model loading and adapter selection logic in the frontend code, likely in a directory like src/ or lib/. Check how models are linked to the UI, possibly in configuration files or initialization scripts. Run the build and preview commands to reproduce the error, then trace where the adapter matching fails. Verify the fix by selecting a model in the UI and ensuring it loads without the error.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, nodejs, typescript
Domain
frontend, tooling
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.