facebookresearch / facebookresearch/jepa

Context encoder and predictor weights

Open
#91 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4.1k
Forks
422
PR merge metrics
No merged PRs in 30d

Description

@MidoAssran @soniajoseph Thanks for the great work and maintaining the repo. I would like to fine tune the model, but if I am not mistaken, the context encoder and predictor weights are not published. Are you planning to publish those? If not, can I use target encoder weights as context encoder weights and just train a predictor from scratch?

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named in the issue. Start by locating the model-checkpoint and weight-loading entry points in the repository, then verify whether context-encoder and predictor weights are present or documented. Done means the repository clearly answers whether those weights are published and how fine-tuning should use them.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.