pytorch / pytorch/executorch

add training for LSTM models completely on device

Open
#14,705 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
5k
Forks
1.2k
Avg merge
2d 10h
Merged PRs (30d)
581

Description

🚀 The feature, motivation and pitch

I've seen lots of examples of tuning embeddings, centroids and adding weights to the dense heads of an LSTM model but I want to know if it's possible to basically pass in data for the model to be trained on fully on device.

This way there are no privacy concerns and it's all personalized on device. Currently I've seen use cases for LLM's and things that aren't personalized so you can keep the underlying model frozen but that won't fit my usecase.

Alternatives

With powerful devices coming out, and if we can have the model be trained on off hours when the users device is charging and plugged in I'm wondering if this is feasible, given that the data might not be large.

Additional context

No response

RFC (Optional)

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no implementation files, tests, or entry points. Start by reviewing ExecuTorch's existing on-device training support and LSTM-related capabilities; done would require an agreed scope for private, personalized training and a concrete validation plan.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
embedded-iot, machine-learning, mobile-dev
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
18/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.