kitlangton / kitlangton/Hex

Unload model after inactivity

Open
#82 0 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Swift
Stars
2.9k
Forks
226
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**
Local models use a fair amount of RAM. That’s fine during live transcription, but when the app is idle, it feels wasteful to keep the model loaded.

**Describe the solution you'd like**
Unload the model after some period of inactivity — for example, after 5 minutes with no input.

**Additional context**
In the screenshot, you can see memory usage in Activity Monitor: yellow before closing the app, green after.
Also, when the app first starts, the model isn’t loaded until the dictation key is pressed. That behavior makes sense and ideally should apply after the first dictation too.

![Image](https://github.com/user-attachments/assets/f85b3bc7-c9c9-4d58-87f5-56ec1ea5d448)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the existing lazy model loading triggered by the dictation key in the Swift macOS app. Review how inactivity and model lifetime are currently handled, then verify that the model is released after the requested idle period and loaded again on the next dictation.

Written by the indexing model from the issue text.

Assessment

Tech stack
macos, swift
Domain
desktop
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.