huggingface / huggingface/swift-chat

Model loads twice

Open
#21 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Swift
Stars
597
Forks
49
PR merge metrics
No merged PRs in 30d

Description

Hey there! I noticed especially when loading large models, the model is loaded once, then unloaded from memory, then re-loaded.

I believe this has to do with the model being loaded in the .onAppear() which can trigger a reload of the UI (since the language model is stored in state).

I had a similar issue in my own iOS app.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.