ivrit-ai / ivrit-ai/explore

Feature: Add Filtering by Log-Probability (Whisper Confidence)

Open
#22 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2
Forks
1
PR merge metrics
No merged PRs in 30d

Description

All transcripts in the system come with token-level log-probabilities from the Whisper model. These values reflect the model’s confidence and can help users surface only high-certainty matches.

**Proposal**:
Add an optional filter that lets users restrict search results based on a minimum log-probability threshold (e.g., filter out tokens below –3.0). This can be exposed as:
- a numeric slider (log-prob range), or
- preset buttons (e.g., all, medium confidence, high confidence).

**Why it’s useful:**
- Reduces noise from low-confidence ASR segments.
- Enables more trustable keyword/regex searches.
- Helps with downstream workflows where accuracy of the match is important.

**Implementation notes:**
- Filtering should occur after match extraction, using per-token or segment-level log-probs already stored in the DB.
- Consider exposing average log-prob per snippet, and allow filtering by snippet-mean vs. token-min.
- Ensure UI clearly indicates when confidence filtering is active.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing search match extraction and the stored per-token or segment-level log-probabilities from the Whisper transcripts. Resolve whether filtering uses snippet means or token minima, then identify the UI entry point for a slider or presets. Done means results can be filtered by the chosen threshold and the UI clearly indicates when confidence filtering is active.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend, databases, frontend, search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.