loktar00 / loktar00/Browser-AI

Add secondary LLM selection for chunking

Open
#43 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
2
Forks
0
PR merge metrics
No merged PRs in 30d

Description

The chunking process can take a while if you're using a larger local model, a lot of 32b models should be able to handle it well, maybe even 14b. We should allow users to select a different model for our condensing logic.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the chunking process and its condensing logic to find where the current model is selected. Determine how users select the primary model, then define the corresponding secondary-model selection and verify that condensing uses it without changing the main model choice.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
ai
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.